-- Logs begin at Mon 2022-07-25 08:02:09 UTC, end at Mon 2022-07-25 08:57:36 UTC. -- Jul 25 08:28:48.757586 dv-cinder-850840-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 08:28:48.767558 dv-cinder-850840-1-smb devstack@keystone.service[80311]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 08:28:48 2022] *** Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: nodename: dv-cinder-850840-1-smb Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: machine: x86_64 Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: clock source: unix Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: pcre jit disabled Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: detected number of CPU cores: 4 Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: current working directory: / Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: detected binary path: /usr/bin/uwsgi-core Jul 25 08:28:48.769570 dv-cinder-850840-1-smb devstack@keystone.service[80311]: your processes number limit is 47680 Jul 25 08:28:48.770235 dv-cinder-850840-1-smb devstack@keystone.service[80311]: your memory page size is 4096 bytes Jul 25 08:28:48.770235 dv-cinder-850840-1-smb devstack@keystone.service[80311]: detected max file descriptor number: 2048 Jul 25 08:28:48.770235 dv-cinder-850840-1-smb devstack@keystone.service[80311]: lock engine: pthread robust mutexes Jul 25 08:28:48.770235 dv-cinder-850840-1-smb devstack@keystone.service[80311]: thunder lock: enabled Jul 25 08:28:48.770235 dv-cinder-850840-1-smb devstack@keystone.service[80311]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 08:28:48.770235 dv-cinder-850840-1-smb devstack@keystone.service[80311]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 08:28:48.811081 dv-cinder-850840-1-smb devstack@keystone.service[80311]: Python main interpreter initialized at 0x55bbb27559c0 Jul 25 08:28:48.811081 dv-cinder-850840-1-smb devstack@keystone.service[80311]: python threads support enabled Jul 25 08:28:48.811081 dv-cinder-850840-1-smb devstack@keystone.service[80311]: your server socket listen backlog is limited to 100 connections Jul 25 08:28:48.811081 dv-cinder-850840-1-smb devstack@keystone.service[80311]: your mercy for graceful operations on workers is 90 seconds Jul 25 08:28:48.811428 dv-cinder-850840-1-smb devstack@keystone.service[80311]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 08:28:48.811511 dv-cinder-850840-1-smb devstack@keystone.service[80311]: *** Operational MODE: preforking *** Jul 25 08:28:48.811740 dv-cinder-850840-1-smb devstack@keystone.service[80311]: *** uWSGI is running in multiple interpreter mode *** Jul 25 08:28:48.811740 dv-cinder-850840-1-smb devstack@keystone.service[80311]: spawned uWSGI master process (pid: 80311) Jul 25 08:28:48.811934 dv-cinder-850840-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 08:28:48.813072 dv-cinder-850840-1-smb devstack@keystone.service[80311]: spawned uWSGI worker 1 (pid: 80320, cores: 1) Jul 25 08:28:48.813072 dv-cinder-850840-1-smb devstack@keystone.service[80311]: spawned uWSGI worker 2 (pid: 80321, cores: 1) Jul 25 08:28:48.813072 dv-cinder-850840-1-smb devstack@keystone.service[80311]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 08:28:54.313728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:28:54.313728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: from cryptography.utils import int_from_bytes Jul 25 08:28:54.314522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:28:54.314522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: from cryptography.utils import int_from_bytes Jul 25 08:28:54.314636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:28:54.314636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: from cryptography.utils import int_from_bytes Jul 25 08:28:54.315043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:28:54.315043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: from cryptography.utils import int_from_bytes Jul 25 08:28:54.363103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:28:54.363294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:28:54.363515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] command line args: [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:28:54.363614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:28:54.363788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:28:54.363874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:28:54.363957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ================================================================================ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:28:54.364031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] command line args: [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:28:54.364202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] admin_token = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.364289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:28:54.364415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ================================================================================ {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:28:54.364500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] config_dir = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.364619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.364705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] admin_token = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.364784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] config_source = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.364902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] config_dir = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.364981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] debug = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] config_source = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] debug = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.365965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366159 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_config_append = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.366882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_dir = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_config_append = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_dir = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_file = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.367993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.368946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.369893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.370022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.370103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.370180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.370304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.370379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] publish_errors = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.371971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] publish_errors = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.372930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] standard_threads = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] standard_threads = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] use_journal = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] use_json = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.373947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] use_stderr = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] use_journal = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] use_syslog = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] use_json = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] use_stderr = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.374618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] use_syslog = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:28:54.374847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.375852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.376979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.377934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378253 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.378951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.379942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.380901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.381969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.382978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.383941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.384989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.385998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.386959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.387919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.388974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.389991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.390940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.391928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.392994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.393929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.394949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.395908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.396968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397656 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.397978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.398931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.external = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.external = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.399945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400061 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.password = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.token = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.password = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] auth.token = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.400954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.401926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.402968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.403929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.404897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.405910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.406994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.407969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.408927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.409942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.410883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.411988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.412949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.413985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.414904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.415872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.416958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.417037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.417192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.417274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.417927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.418981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.419901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.420892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.421934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.422967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.423921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.424991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.425903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.426992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.427979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.428913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.429932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.430861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.431996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] role.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.432927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] role.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.433037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.433721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.433813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] role.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.433971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] role.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.434937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.435920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.436966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.437983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.438951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.439980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.440948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.441863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.442957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.443929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444159 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.444936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.445874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.connection = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.446883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.447983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.448951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.449977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:28:54.450599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:28:54.450989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:28:54.479444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.479675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.480357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.480444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.480509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.480687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.488731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.489033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.519044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.519267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.519355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.519528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.572207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.572900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.623267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.623514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.623626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.623846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.688948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.689031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.689162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.689249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.689377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.711909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.712883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.713007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.713090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.713216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.713299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.713479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.724976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.725419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.737998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.738958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.739082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.739165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.739291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.739374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.739551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80321) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:28:54.756489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.756700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:28:54.757036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.757120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.757235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:28:54.757320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:28:54.757499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.757609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.757751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.757835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:28:54.758003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.758086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.758256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.758339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.758554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.758810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.769055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.769326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.769590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.769674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.769867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.769965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.770155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.770435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.778620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.779252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.781929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.782207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.782486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.782570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.782765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.782862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.783862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.784936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.785156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.813543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.813965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.815137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.815435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.815591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.815869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.820703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.821094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.821222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.821380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.821519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.821784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.828722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.828960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.829147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.829430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.833440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.833727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.833905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.834036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.834988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.835116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.835242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.835368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.835521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.835779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.854623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.855004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.855802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.856079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.860113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.860643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.863773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.864166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.864334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.864733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.869188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.869754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.872849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.873428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.876488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.876784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.877877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.878006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.878158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.878448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.897524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.897807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.898083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.898312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.898312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.898607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.898784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.898949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.906284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.907040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.907989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.908262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.908770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.909043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.911442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.911722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.912001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.912232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.912363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.912516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.912655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.912784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.913071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.913349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.928561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.928855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.929134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.929412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.929785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.930075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.930487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.930620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.931288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.931808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.932158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.932542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.932837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.933699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.949162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.951595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.952446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.954869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.955758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.957500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.958204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.959126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.959420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.959695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.959976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.961614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.961893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.962171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.967242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.969028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.969751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.971805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.972271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.972558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.972945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.973239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.975031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.975321 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.975735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.976024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.982818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.983100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.983376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.985671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.985960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.986240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.991194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.991495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.991771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.992040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.992307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.992682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.992955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.993232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.993510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.993778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.994056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.994194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80321) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:28:54.994323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.994459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.994586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.994712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.994847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.995027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.995156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.995546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.996336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.996620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.996902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.997180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.997454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.997716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.997997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:54.998262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80321) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:28:55.033197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bbb27559c0 pid: 80320 (default app) Jul 25 08:28:55.035837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bbb27559c0 pid: 80321 (default app) Jul 25 08:28:55.036713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead7ea-57f0-4b45-89a1-029e3fc23510 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:28:55.037005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead7ea-57f0-4b45-89a1-029e3fc23510 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:28:55.037281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead7ea-57f0-4b45-89a1-029e3fc23510 None None] PATH_INFO: `/v3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:28:55.041505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Mon Jul 25 08:28:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:02.585766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:02.586235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:02.586334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:02.590676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:02.596220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:02.596656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:02.596773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:02.667288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: INFO dbcounter [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] Registered counter for database keystone Jul 25 08:29:02.689341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG oslo_db.sqlalchemy.engines [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:29:02.695469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writer thread running {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:29:02.871258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG passlib.handlers.bcrypt [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80320) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 08:29:02.871626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG passlib.handlers.bcrypt [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80320) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 08:29:02.926145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:02.927792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:03.057375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 08:29:03.212043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:03.283323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: INFO dbcounter [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] Registered counter for database keystone Jul 25 08:29:03.304932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG oslo_db.sqlalchemy.engines [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:29:03.311088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writer thread running {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:29:03.432327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4aed-e7a7-4f5d-a3f1-6d9106eff76b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:03.437189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:03.437848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:03.438132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:03.438407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:03.446460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:03.496845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 08:29:03.497135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26e25d-2f19-4ac9-a647-af9e89c37ae1 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:03.506584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Jul 25 08:29:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:29:03.512633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:03.527050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36479d7-be46-4e1c-8497-b7f3a365c62d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:03.532045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:03.533170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:03.533456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:03.533729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] PATH_INFO: `/v3/projects/bf189989f41048d2bcf89c6d65f2316e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:03.535250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] RBAC: Authorizing `identity:get_project(project_id=bf189989f41048d2bcf89c6d65f2316e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:03.586654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 08:29:03.587008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4803d-e8d7-46cd-b334-e58847776207 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:03.592410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Jul 25 08:29:03 2022] GET /identity/v3/projects/bf189989f41048d2bcf89c6d65f2316e => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:05.579449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9df3-c9bb-4606-955c-b2405722596b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:05.579864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9df3-c9bb-4606-955c-b2405722596b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:05.580007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9df3-c9bb-4606-955c-b2405722596b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:05.584134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:05.589334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:05.589751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:05.589898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:05.610527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:05.612079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:05.619996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 08:29:05.642022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9df3-c9bb-4606-955c-b2405722596b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:05.653868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9df3-c9bb-4606-955c-b2405722596b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:05.658050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f7cf-fdba-492c-9ac6-e0e058ebe474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:05.658672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f7cf-fdba-492c-9ac6-e0e058ebe474 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:05.658956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f7cf-fdba-492c-9ac6-e0e058ebe474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:05.659233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f7cf-fdba-492c-9ac6-e0e058ebe474 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:05.666822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f7cf-fdba-492c-9ac6-e0e058ebe474 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:05.669186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f7cf-fdba-492c-9ac6-e0e058ebe474 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:05.677801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Jul 25 08:29:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:29:05.682710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:05.692236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a9a3a-12b4-4bf3-84d6-0e2f71c937f9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:05.696802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda96aba-06d2-4baf-bbf4-347bfc7f2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:05.697676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda96aba-06d2-4baf-bbf4-347bfc7f2761 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:05.697968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda96aba-06d2-4baf-bbf4-347bfc7f2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:05.698248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda96aba-06d2-4baf-bbf4-347bfc7f2761 admin admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:05.699734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda96aba-06d2-4baf-bbf4-347bfc7f2761 admin admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:05.701582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda96aba-06d2-4baf-bbf4-347bfc7f2761 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:05.703173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Jul 25 08:29:05 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:07.740368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de73b2-3cc8-49d1-a99e-e8f8b0b39f57 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:07.740868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de73b2-3cc8-49d1-a99e-e8f8b0b39f57 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:07.740968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de73b2-3cc8-49d1-a99e-e8f8b0b39f57 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:07.742293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:07.747942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:07.748338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:07.748507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:07.766164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:07.767371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:07.780417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511683d-fc38-46ec-961d-d507a0a573f8 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:07.780876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511683d-fc38-46ec-961d-d507a0a573f8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:07.781157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511683d-fc38-46ec-961d-d507a0a573f8 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:07.782511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:07.787492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:07.787783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:07.788066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:07.831828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG passlib.handlers.bcrypt [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80321) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 08:29:07.832162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG passlib.handlers.bcrypt [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80321) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 08:29:07.847184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:07.870333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:07.878415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:07.880052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:07.894228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:07.974788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e3371-8de0-4df1-8f9e-407f5a734811 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:07.980028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:08.001733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.008324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.009125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.009420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.009700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.020766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:08.032487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:08.033547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:08.034364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:08.039262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.100536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2288347-3dcf-4605-afa2-01a61c0a46c8 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.103043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:08.122275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:08.140757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.141004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723917cd-d256-4e8a-9c34-54377ec2fc83 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.141679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.141967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.142532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.175405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.176073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.176361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.176637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.177401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:08.177709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.179103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.191191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:08.196684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.212065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.213589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.294302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e13d64-afc0-4000-94dc-47548807f07f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.310615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:29:08.316298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.318921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:08.328361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.329237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.329524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.329799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.331010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.332489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.334111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:08.339320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.354098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:08.413721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05f8af-0039-4da3-9f8b-ef3ad9e5a4c6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.438609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700991-3a99-4f92-ac12-704b018c2a7c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.447541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.448334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.448618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.448890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.467924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.470718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.471783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.472582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.472872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.473151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.474359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.475842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.477488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:08.483699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:29:08.498021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:08.498826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:08.499806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:29:08.499806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:29:08.499806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:29:08.499806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:08.499806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:08.505010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:08.561163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:08.569263 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:08.589015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb8ef5-ad8a-4822-b712-03d3811e0122 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.604428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f81ac-af5a-4779-8cbb-80ee1536c8b1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:08.623457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.624115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.624400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.624677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.625515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.domain.id=default, user.id=8cead41321b144bab20ff36d66ca2d2a) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:08.625821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.627287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52691207-14ab-4906-a7cc-5fb9127238f7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.633905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1322 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/role_assignments?user.id=8cead41321b144bab20ff36d66ca2d2a&scope.domain.id=default&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:08.638841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:08.639562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:08.639851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:08.640129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:08.640914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:08.641226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:08.642678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a069a-698a-419e-ae33-d563bfa061d3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:08.662574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:10.766625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e4fd-fb77-4963-a522-aca36f4099c9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:10.767687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e4fd-fb77-4963-a522-aca36f4099c9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:10.768181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e4fd-fb77-4963-a522-aca36f4099c9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:10.770080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:10.774994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580a95-f134-4b13-af62-404abdee6179 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:10.775860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580a95-f134-4b13-af62-404abdee6179 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:10.776362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580a95-f134-4b13-af62-404abdee6179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:10.804491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-e4580a95-f134-4b13-af62-404abdee6179 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:10.806027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e4580a95-f134-4b13-af62-404abdee6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:10.890264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:10.925236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e4fd-fb77-4963-a522-aca36f4099c9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:11.044448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ace88-39fc-470a-a93b-4f8f2eb6bd93 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.044776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ace88-39fc-470a-a93b-4f8f2eb6bd93 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.045014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ace88-39fc-470a-a93b-4f8f2eb6bd93 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.046391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:11.073050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2fa4a-03a0-4fc0-8b89-37f54a3fe448 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.073335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2fa4a-03a0-4fc0-8b89-37f54a3fe448 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.073602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2fa4a-03a0-4fc0-8b89-37f54a3fe448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.087843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e4fd-fb77-4963-a522-aca36f4099c9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:11.120422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3da2fa4a-03a0-4fc0-8b89-37f54a3fe448 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:11.122195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3da2fa4a-03a0-4fc0-8b89-37f54a3fe448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:11.138500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f16296-5c47-4e98-abbb-e95c67350689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:11.139309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f16296-5c47-4e98-abbb-e95c67350689 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.139869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f16296-5c47-4e98-abbb-e95c67350689 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.140153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f16296-5c47-4e98-abbb-e95c67350689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.151160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f16296-5c47-4e98-abbb-e95c67350689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-73f16296-5c47-4e98-abbb-e95c67350689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:11.159355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:11.160204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:11.160960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 13/25] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:11.167407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109e6b-ce52-4e75-859f-bbc463b5c0d2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.167407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109e6b-ce52-4e75-859f-bbc463b5c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.167407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109e6b-ce52-4e75-859f-bbc463b5c0d2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.167407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 14/26] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:11.167407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109e6b-ce52-4e75-859f-bbc463b5c0d2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:11.193236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:11.208109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:11.257166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:11.263407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.264386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.264893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.293249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:11.294792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:11.431804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:11.432704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:11.552093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109e6b-ce52-4e75-859f-bbc463b5c0d2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:11.579959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b82a6b-863b-4333-9ef5-c11967c3399e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:11.588496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:11.622902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:11.624490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.625065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.625478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.626374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:11.627930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:11.645721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:11.646417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.646719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.646990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.647792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:11.648106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:11.649523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:11.668132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 15/29] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:11.669614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:11.795851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:11.871068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa43bd8-6d46-43a5-b176-95856703abc5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:11.916440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 15/30] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Jul 25 08:29:11 2022] POST /identity/v3/roles => generated 219 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:11.918165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:11.933716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:11.935554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:11.936767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:11.937397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:11.963816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:11.965751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1ccefda1-1fa0-40e1-bb53-5da4e6292bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:29:12.004646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:12.005593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:12.006360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:29:12.006360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:29:12.006360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:29:12.006360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:12.008317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 16/31] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:12.009911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2944-372b-4053-aab7-90e4c7420dcd None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.010375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2944-372b-4053-aab7-90e4c7420dcd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.010863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2944-372b-4053-aab7-90e4c7420dcd None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.013368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 17/32] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:12.014548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2944-372b-4053-aab7-90e4c7420dcd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:12.077948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd391-8bae-4bf1-807e-653c62d2a3ee None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:12.125243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5529e6-23b3-470b-86b3-f6fbc26f5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:12.126499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5529e6-23b3-470b-86b3-f6fbc26f5348 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.127011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5529e6-23b3-470b-86b3-f6fbc26f5348 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.127533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5529e6-23b3-470b-86b3-f6fbc26f5348 None admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.129999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5529e6-23b3-470b-86b3-f6fbc26f5348 None admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:12.131836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5529e6-23b3-470b-86b3-f6fbc26f5348 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.134205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 16/33] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:11 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:12.135798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.136299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.136771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.163354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:12.165265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:12.216279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:12.220359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2944-372b-4053-aab7-90e4c7420dcd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:12.255422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:12.287171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 17/34] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:12.287880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:12.295482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:12.301592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.301879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.302254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.314002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:12.314327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:12.316258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.338917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:12.339629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:12.453518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df424d-1d95-43f4-b51a-fc49e1dcc3df None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:12.460142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129aa74-fffc-4e13-9274-2da3e5fc65f8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:12.490178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:12.490979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.491267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.491574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.492754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:12.494292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.496072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 18/36] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:12.498668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f6d04-3127-4466-9527-3d720263fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:12.499348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6d04-3127-4466-9527-3d720263fc04 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.499671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6d04-3127-4466-9527-3d720263fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.499961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6d04-3127-4466-9527-3d720263fc04 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.500724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f6d04-3127-4466-9527-3d720263fc04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:12.501110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:12.502158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f6d04-3127-4466-9527-3d720263fc04 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.536964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:12.609929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502776-2b61-4db1-b80b-a5d771d6b643 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:12.631791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Jul 25 08:29:12 2022] POST /identity/v3/roles => generated 225 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:12.633412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2359c3-200a-4fc5-8f66-677d0a096f68 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.633709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2359c3-200a-4fc5-8f66-677d0a096f68 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.633987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2359c3-200a-4fc5-8f66-677d0a096f68 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.635448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 20/38] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:12.636048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2359c3-200a-4fc5-8f66-677d0a096f68 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:12.651251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed979f-9065-4259-9e09-67086fa69a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:12.651976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed979f-9065-4259-9e09-67086fa69a7e None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.652263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed979f-9065-4259-9e09-67086fa69a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.654131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed979f-9065-4259-9e09-67086fa69a7e None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.654890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed979f-9065-4259-9e09-67086fa69a7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:12.663524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed979f-9065-4259-9e09-67086fa69a7e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.700620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:29:12 2022] POST /identity/v3/projects => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:12.702203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786d53-9262-43c0-b561-b0e16f1894d2 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.702599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786d53-9262-43c0-b561-b0e16f1894d2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.702975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786d53-9262-43c0-b561-b0e16f1894d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.705252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:12.739839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a0786d53-9262-43c0-b561-b0e16f1894d2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:12.741512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a0786d53-9262-43c0-b561-b0e16f1894d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:12.795205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2359c3-200a-4fc5-8f66-677d0a096f68 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:12.827107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 20/40] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:12.833623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4605fad-2469-466c-8c7d-d1949a3edb02 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.833945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4605fad-2469-466c-8c7d-d1949a3edb02 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.834681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4605fad-2469-466c-8c7d-d1949a3edb02 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.836523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 21/41] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:12.843926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.844236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.844494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.848851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:12.849760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:12.850046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:12.850325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] PATH_INFO: `/v3/domains/default/users/8cead41321b144bab20ff36d66ca2d2a/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:12.854296 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8cead41321b144bab20ff36d66ca2d2a, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:12.856483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:12.878132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:12.878551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1361 bytes} [Mon Jul 25 08:29:12 2022] PUT /identity/v3/domains/default/users/8cead41321b144bab20ff36d66ca2d2a/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:12.879405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:12.879576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:12.891366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:12.979508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 22/43] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:13.003935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:13.016672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:13.021006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b8673-eb9d-4883-85d0-e1fc799a5ca6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:13.062986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:13.063830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:13.064119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:13.064402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:13.065605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:13.067094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:13.068955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 22/44] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:13.074406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:13.118961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4421f8-3fd0-42e2-a26a-64f1998389af None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:13.169466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04eb7e-e5f7-471e-b366-72988b3c8dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:13.170076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04eb7e-e5f7-471e-b366-72988b3c8dbf None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:13.170558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04eb7e-e5f7-471e-b366-72988b3c8dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:13.170985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04eb7e-e5f7-471e-b366-72988b3c8dbf None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:13.172221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04eb7e-e5f7-471e-b366-72988b3c8dbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:13.174615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04eb7e-e5f7-471e-b366-72988b3c8dbf None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:13.203424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Jul 25 08:29:13 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:29:13.203629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc508-2d06-4e19-8d24-83669ff84999 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:13.259171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60303fdf-20d1-41d6-b35e-2a8e0c9baed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:13.259908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60303fdf-20d1-41d6-b35e-2a8e0c9baed8 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:13.260204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60303fdf-20d1-41d6-b35e-2a8e0c9baed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:13.260492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60303fdf-20d1-41d6-b35e-2a8e0c9baed8 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:13.261238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60303fdf-20d1-41d6-b35e-2a8e0c9baed8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:13.262783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60303fdf-20d1-41d6-b35e-2a8e0c9baed8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:13.301183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:29:13 2022] POST /identity/v3/projects => generated 312 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:29:15.343669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800c95-2b52-4efb-8b88-48cc67740c7e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.344195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800c95-2b52-4efb-8b88-48cc67740c7e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.344277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800c95-2b52-4efb-8b88-48cc67740c7e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.345622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:15.350816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.351238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.351372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.370437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:15.372008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:15.385196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:15.439363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:15.457630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b94e21-8351-41bd-bb69-c79da243a1ad None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.457927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b94e21-8351-41bd-bb69-c79da243a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.458216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b94e21-8351-41bd-bb69-c79da243a1ad None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.459892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 25/49] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:15.462654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:15.465025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.465356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.466152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.473463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:15.484612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:15.485808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:15.552999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 26/50] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:15.565340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be263-054a-4da8-ad1d-feb064cf056a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:15.575992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:15.599436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:15.600154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.600439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.600713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.601886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:15.603366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:15.605012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 25/51] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:15.610845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:15.629042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:15.674641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b38dfa-0188-4212-b992-a7efc9be0c9c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:15.708665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:15.709041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09033a9c-8757-4318-8aec-6b398291f201 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:15.709582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.709895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.710178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.712198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:15.722765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:15.731889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:15.732880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:15.736104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 27/52] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:15.738784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:15.746038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:15.747215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.747533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.747815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.748529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:15.749999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:15.776051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 26/53] 10.222.0.57 () {60 vars in 1140 bytes} [Mon Jul 25 08:29:15 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:15.859347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebfd88-8b73-4158-bc41-2a5bd51a79be None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:15.894409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:15.895102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:15.895416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:15.895698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:15.896475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:15.896787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:15.898257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:15.911415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 28/54] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:15.917234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:15.985901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:16.019946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb1ac-fbf1-4643-9acb-35654ec98434 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:16.052872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:16.053753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:16.054037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:16.054314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:16.055537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:16.057007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:16.058651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:15 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:16.064981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:16.120089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:16.164126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d960-8a7e-4029-b49d-b802338d9736 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:16.198977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b932-2f61-40e3-9f59-ce8e28a3ec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:16.199864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b932-2f61-40e3-9f59-ce8e28a3ec3c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:16.200156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b932-2f61-40e3-9f59-ce8e28a3ec3c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:16.200438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b932-2f61-40e3-9f59-ce8e28a3ec3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:16.201613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b932-2f61-40e3-9f59-ce8e28a3ec3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:16.203085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b932-2f61-40e3-9f59-ce8e28a3ec3c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:16.204757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 29/56] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:16.210596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:16.312001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db62e82-c46a-431c-a52e-34097d146fa2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:16.345172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:16.345834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:16.346123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:16.346404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:16.347243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.domain.id=default, user.id=8cead41321b144bab20ff36d66ca2d2a) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:16.347595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:16.349060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0acf20-88bf-46e0-8229-bc00f2221ed1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:16.351951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:16.355495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1322 bytes} [Mon Jul 25 08:29:16 2022] GET /identity/v3/role_assignments?user.id=8cead41321b144bab20ff36d66ca2d2a&scope.domain.id=default&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:17.780018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819583a-bcdb-4fd4-b818-2b1cab8dca6a None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:17.780514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819583a-bcdb-4fd4-b818-2b1cab8dca6a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:17.780597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819583a-bcdb-4fd4-b818-2b1cab8dca6a None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:17.781981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 30/58] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:17.787140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:17.787580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:17.787722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:17.805905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:17.807033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:17.871715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 29/59] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:17.896888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819583a-bcdb-4fd4-b818-2b1cab8dca6a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:17.996546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819583a-bcdb-4fd4-b818-2b1cab8dca6a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:18.019580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:18.030948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7048f8-a5ff-43b8-bf36-ff792f8becac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:18.031760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7048f8-a5ff-43b8-bf36-ff792f8becac None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:18.032048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7048f8-a5ff-43b8-bf36-ff792f8becac None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:18.032326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7048f8-a5ff-43b8-bf36-ff792f8becac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:18.033488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7048f8-a5ff-43b8-bf36-ff792f8becac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:18.034937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7048f8-a5ff-43b8-bf36-ff792f8becac None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:18.036590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 31/60] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:18.042086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:18.137804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed65324-e2fc-48f5-8404-fbad59bc1bbf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:18.165332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:18.171267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92314429-f64e-4d02-a42b-846d5cf0a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:18.171954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92314429-f64e-4d02-a42b-846d5cf0a419 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:18.172241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92314429-f64e-4d02-a42b-846d5cf0a419 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:18.172515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92314429-f64e-4d02-a42b-846d5cf0a419 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:18.173213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92314429-f64e-4d02-a42b-846d5cf0a419 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:18.174652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92314429-f64e-4d02-a42b-846d5cf0a419 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:18.201226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 30/61] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:18 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:21.093899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc677cc-db52-466b-8d0e-7c04059a54a2 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.094802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc677cc-db52-466b-8d0e-7c04059a54a2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.095233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc677cc-db52-466b-8d0e-7c04059a54a2 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.096814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 32/62] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:21.102000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.102732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.103183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.132386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:21.133832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:21.221761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 31/63] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:21.256527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc677cc-db52-466b-8d0e-7c04059a54a2 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:21.392164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc677cc-db52-466b-8d0e-7c04059a54a2 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:21.438557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247f75-71f8-48f5-b1d8-ceee3fb18ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:21.439664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247f75-71f8-48f5-b1d8-ceee3fb18ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.440112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247f75-71f8-48f5-b1d8-ceee3fb18ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.440536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247f75-71f8-48f5-b1d8-ceee3fb18ac1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.460397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e247f75-71f8-48f5-b1d8-ceee3fb18ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-0e247f75-71f8-48f5-b1d8-ceee3fb18ac1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:21.469037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:21.469868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:21.470881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 33/64] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:21.476493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:21.517836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86b4ea-058b-43f3-b379-bf29a378844c None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.518402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86b4ea-058b-43f3-b379-bf29a378844c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.518854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86b4ea-058b-43f3-b379-bf29a378844c None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.520546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 34/65] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:21.525807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975d12e-568e-445a-bed5-1626982fb0d6 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.526309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975d12e-568e-445a-bed5-1626982fb0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.526749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975d12e-568e-445a-bed5-1626982fb0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.568620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-e975d12e-568e-445a-bed5-1626982fb0d6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:21.569853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e975d12e-568e-445a-bed5-1626982fb0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:21.633319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:21.645701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565697-fa0a-45da-a554-48c67e698aa9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:21.658693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:21.660513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a490-53a3-4569-bf61-c51330702d3f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.660809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a490-53a3-4569-bf61-c51330702d3f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.661389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a490-53a3-4569-bf61-c51330702d3f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.663518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 36/67] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:21.664788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:21.676792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.677084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.677368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.698913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:21.700181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:21.702639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:21.703481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.703834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.704175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.705123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:21.705605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:21.707189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:21.721656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 32/68] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:21.722713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:21.780772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 37/69] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:21.781849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:21.838568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c716-04ec-4f05-b498-33b55882f03b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:21.876017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430cf13-8e70-4cc7-92ba-178c07f034aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:21.877036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430cf13-8e70-4cc7-92ba-178c07f034aa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.877461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430cf13-8e70-4cc7-92ba-178c07f034aa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.877995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430cf13-8e70-4cc7-92ba-178c07f034aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.889592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430cf13-8e70-4cc7-92ba-178c07f034aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:21.890535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b625-ca24-4710-bc95-149489c25c6f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0430cf13-8e70-4cc7-92ba-178c07f034aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:21.898196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:21.899073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:21.900219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 33/70] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:21.905507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:21.905925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a034-92cf-4184-b8cd-255783f38d70 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.906209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a034-92cf-4184-b8cd-255783f38d70 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.906492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a034-92cf-4184-b8cd-255783f38d70 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.907830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 34/71] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:21.908658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358a034-92cf-4184-b8cd-255783f38d70 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:21.933428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:21.934315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:21.935026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:21.935315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:21.953987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:21.955586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:21.957925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:21.960029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 38/72] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:21 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:21.960948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.026590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358a034-92cf-4184-b8cd-255783f38d70 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.061751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579bc1d-902c-4086-b8cc-f9bf97a66e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.062550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579bc1d-902c-4086-b8cc-f9bf97a66e85 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.062838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579bc1d-902c-4086-b8cc-f9bf97a66e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.063115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579bc1d-902c-4086-b8cc-f9bf97a66e85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.063529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32759ff1-fd7b-4bd7-8106-c67f21157cd7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.073261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579bc1d-902c-4086-b8cc-f9bf97a66e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a579bc1d-902c-4086-b8cc-f9bf97a66e85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:22.081460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:22.082452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 35/73] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:22.088129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c5cd1-25ac-476e-82ca-cab61f7613ce None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.088800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c5cd1-25ac-476e-82ca-cab61f7613ce None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.088800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c5cd1-25ac-476e-82ca-cab61f7613ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.098506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.099176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.099492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.099773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.100527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:22.100835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.102233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.102802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a57c5cd1-25ac-476e-82ca-cab61f7613ce None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:22.104048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a57c5cd1-25ac-476e-82ca-cab61f7613ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:22.110532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 39/74] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:22.111319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.147135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.181017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 36/75] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:22.182284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511465-1d9c-4583-a826-bb8a788c4f60 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.182555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511465-1d9c-4583-a826-bb8a788c4f60 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.182838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511465-1d9c-4583-a826-bb8a788c4f60 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.184368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 37/76] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:22.184879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc511465-1d9c-4583-a826-bb8a788c4f60 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.212984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.228267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2306-0471-4b79-8fab-42c7800c0595 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.262040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9368f-6fb5-4cfd-9e94-890204cea3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.263227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9368f-6fb5-4cfd-9e94-890204cea3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.263549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9368f-6fb5-4cfd-9e94-890204cea3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.263831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9368f-6fb5-4cfd-9e94-890204cea3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.286101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc511465-1d9c-4583-a826-bb8a788c4f60 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.319665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.320332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.320621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.320901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.321655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:22.321963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.323360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.329921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9368f-6fb5-4cfd-9e94-890204cea3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.331374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9368f-6fb5-4cfd-9e94-890204cea3a0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.331907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 38/77] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:22.332680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.361449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.426893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.429136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 40/78] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:22.430506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.430809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.431153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.437674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756d55-58b7-489a-9cfa-b872ea9c9b3b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.449599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:22.451371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:22.473357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.474391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.474678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.474955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.476182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.477628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.479260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 39/79] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:22.480041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.521554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 41/80] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:22.522389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.589456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.603620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96180e0-24cf-4a63-bc41-9498c8fd9c67 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.632385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d763b1-ecf6-424c-82bd-eb6e7a61c9bd None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.643312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.644533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.645035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.645471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.646863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.648967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.650658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 40/81] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:22.651550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.674847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.675869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.676158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.676441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.677901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.679093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.680245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.680774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 42/82] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:22.681598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.768385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5d75-89df-4200-a381-009021ae4566 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.787604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef533b9-914b-4b97-adf3-9d3f019f2ac7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.803750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.804694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.805030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.805372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.806657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.808174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.810505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 41/83] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:22.816111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:22.820736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.827554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.828214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.828505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.828789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.901082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:22.902573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:22.910650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:22.917326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5383ac-9042-45e1-ad4e-bc6f49f92aba None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:22.950818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:22.951585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:22.951874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:22.952150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:22.962194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:22.970654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:22.971613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:22.972344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 42/84] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:22.972953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.007087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 43/85] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:23.008193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.038684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.081927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f43d8-5378-4f97-bd04-33c876237961 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.109629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60b3c-50f5-414c-a92c-c860e03e0177 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.115675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.116343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.116631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.116909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.117618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.119076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.140299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 43/86] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:22 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:23.143689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.144367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.144654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.144936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.145203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.163018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.227452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.229816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.262171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.270671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedcb14-f916-4946-9ba7-7164d442a647 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.314045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.314823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.315119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.315477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.316286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=cdc4137cd0c846d48612f811124960c7) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:23.316604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.318088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.323935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 44/87] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/role_assignments?user.id=cdc4137cd0c846d48612f811124960c7&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:23.324757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.353981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 44/88] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:23.359712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.444017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.472668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cdfc9-a0ce-4415-a6bb-fbe53e9978de None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.500267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731e7f-b7fe-4da4-bd46-8128cdd9b866 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.523130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.523850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.524142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.524433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.525216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:23.525526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.527340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.539136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 45/89] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:23.541045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.552665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.560856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.561736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.562020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.562460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.564068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.565952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.569573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 45/90] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:23.570420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.672434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909209-5ad2-4c66-bf56-b3ecbf2dd800 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.689641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05760379-e957-402b-9fb7-28b1ae4c1521 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.712394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.713432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.713725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.714000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.715203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.716903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.719350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 46/91] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:23.720144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.743773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.820726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.821641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.821943 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.822207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.823477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.825571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.827419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 46/92] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:23.828422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.834893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1b76-c816-4a8d-be75-4fbfbe2fdf42 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:23.913453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:23.928419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:23.928796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:23.929092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:23.929375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:23.930222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] RBAC: Adding query filter params (role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=cdc4137cd0c846d48612f811124960c7) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:23.930537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:23.936109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:23.949333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 47/93] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/role_assignments?user.id=cdc4137cd0c846d48612f811124960c7&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:23.950580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:23.969105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb61f3-3bc5-4bae-a0b7-828b73bfa69a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:24.060650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:24.061339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:24.061627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:24.061910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:24.062774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=8cead41321b144bab20ff36d66ca2d2a) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:24.063087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:24.064649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:24.079098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 47/94] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/role_assignments?user.id=8cead41321b144bab20ff36d66ca2d2a&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:24.139772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:24.186871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c8388-6d7e-41a1-804b-eecd6fb45400 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:24.241294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:24.241981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:24.242268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:24.242544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:24.346107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:24.347546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:24.429605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:24.465415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 48/95] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:24.471932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:24.602650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bab52c-af84-496e-9fb4-73768d5fb6a7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:24.631779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:24.639022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f9ae-fa31-45c6-ae41-2baa7c1c42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:24.639935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f9ae-fa31-45c6-ae41-2baa7c1c42d9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:24.640219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f9ae-fa31-45c6-ae41-2baa7c1c42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:24.640497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f9ae-fa31-45c6-ae41-2baa7c1c42d9 None admin] PATH_INFO: `/v3/projects/e060ed7d1c034d099c0de453b802537b` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:24.641727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f9ae-fa31-45c6-ae41-2baa7c1c42d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e060ed7d1c034d099c0de453b802537b)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:24.643357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f9ae-fa31-45c6-ae41-2baa7c1c42d9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:24.645322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 48/96] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:24 2022] GET /identity/v3/projects/e060ed7d1c034d099c0de453b802537b => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:24.650960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:24.767499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0fe6d-f717-4803-ac9b-6719f1755ffe None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:24.810735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:24.811411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:24.811703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:24.811980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:24.812821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=e060ed7d1c034d099c0de453b802537b, user.id=cdc4137cd0c846d48612f811124960c7) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:24.813131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:24.814570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b8920-0e51-4057-9af6-357e8d4224da None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:24.823539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 49/97] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:24 2022] GET /identity/v3/role_assignments?user.id=cdc4137cd0c846d48612f811124960c7&scope.project.id=e060ed7d1c034d099c0de453b802537b&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:25.715246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7140102-892d-49a8-b26a-0d3099bfef59 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:25.715837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7140102-892d-49a8-b26a-0d3099bfef59 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:25.715913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7140102-892d-49a8-b26a-0d3099bfef59 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:25.717251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 49/98] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:25.722758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:25.723140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:25.723316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:25.747937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:25.749151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:25.778212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:25.822002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 50/99] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:25.845212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7140102-892d-49a8-b26a-0d3099bfef59 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:25.973050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7140102-892d-49a8-b26a-0d3099bfef59 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:26.014938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:26.015767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.016056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.016341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.030237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:26.038069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:26.038904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:26.039662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 50/100] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:26.048490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:26.201723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c6a18-f60b-4a83-9daa-f0f1c0fcce69 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:26.245725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:26.246426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.246713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.247333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.248130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:26.248440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:26.249851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d34c1-3033-42ea-b1b2-f4b216da5dea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:26.259098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 51/101] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:26.264382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:26.271903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f912-c6b5-4fe3-9be1-91eb4573d8fb None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.272202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f912-c6b5-4fe3-9be1-91eb4573d8fb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.272482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f912-c6b5-4fe3-9be1-91eb4573d8fb None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.274003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 52/102] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:26.279226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47dc64-b0a9-4775-aaf9-cd118aa82406 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.279592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47dc64-b0a9-4775-aaf9-cd118aa82406 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.279873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47dc64-b0a9-4775-aaf9-cd118aa82406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.309049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1f47dc64-b0a9-4775-aaf9-cd118aa82406 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:26.310285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1f47dc64-b0a9-4775-aaf9-cd118aa82406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:26.336638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:26.359758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:26.386179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84dad0-0edf-45ea-8c6c-a11bd3963dcd None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:26.428990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4981cf1-ccfc-4913-bfaf-244adb681001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:26.429870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4981cf1-ccfc-4913-bfaf-244adb681001 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.430161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4981cf1-ccfc-4913-bfaf-244adb681001 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.430561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4981cf1-ccfc-4913-bfaf-244adb681001 None admin] PATH_INFO: `/v3/users/145c3d6f3cf14863af71421712a4465f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.460240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4981cf1-ccfc-4913-bfaf-244adb681001 None admin] RBAC: Authorizing `identity:get_user(user_id=145c3d6f3cf14863af71421712a4465f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:26.461645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4981cf1-ccfc-4913-bfaf-244adb681001 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:26.463562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 51/103] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:26 2022] GET /identity/v3/users/145c3d6f3cf14863af71421712a4465f => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:26.467476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28009-44de-450d-817f-4e6dbe107cb9 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.467770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28009-44de-450d-817f-4e6dbe107cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.468052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28009-44de-450d-817f-4e6dbe107cb9 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.470143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 52/104] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:26.472321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 53/105] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:26.473013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf28009-44de-450d-817f-4e6dbe107cb9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:26.476154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.476452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.476737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.510801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:26.512019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:26.657011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 54/106] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:26.657944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:26.681380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf28009-44de-450d-817f-4e6dbe107cb9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:26.700955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:26.721912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:26.723272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.723686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.724071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.798627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:26.800289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:26.834631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:26.848202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0c1a-b424-4282-a602-b169f8eeb5db None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:26.884844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:26.885650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:26.885967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:26.886365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:26.898975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:26.908421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:26.909277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 55/107] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:26.910430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:26.983032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 53/108] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:26.987462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.015065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.055454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a46e-fae4-44bf-986b-0e851a8e1b3c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.103219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971cec9-f491-4f76-be76-92ff21b81b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.104323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971cec9-f491-4f76-be76-92ff21b81b49 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.104609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971cec9-f491-4f76-be76-92ff21b81b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.104886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971cec9-f491-4f76-be76-92ff21b81b49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.106833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971cec9-f491-4f76-be76-92ff21b81b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.109041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971cec9-f491-4f76-be76-92ff21b81b49 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.111328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 56/109] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:27.112884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb944-1283-4f2b-8da2-ed30eefbe4f0 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.113172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb944-1283-4f2b-8da2-ed30eefbe4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.113451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb944-1283-4f2b-8da2-ed30eefbe4f0 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.114519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823d596-c267-4385-9c51-30a17dd9423f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.114718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 57/110] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:27.118761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb944-1283-4f2b-8da2-ed30eefbe4f0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.134670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.163757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.164697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.164990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.165271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.166954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:27.167271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.168736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.180256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 54/111] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:27.181069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.258761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb944-1283-4f2b-8da2-ed30eefbe4f0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.270531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.295928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf79681-9616-428a-8870-b4d200a5be02 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.305330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2682ca-f80f-4ada-9649-9ed54f008bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.306256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2682ca-f80f-4ada-9649-9ed54f008bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.306541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2682ca-f80f-4ada-9649-9ed54f008bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.306828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2682ca-f80f-4ada-9649-9ed54f008bf3 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.308670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2682ca-f80f-4ada-9649-9ed54f008bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.310266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2682ca-f80f-4ada-9649-9ed54f008bf3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.314971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 58/112] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:27.316255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b3930-b7a1-4519-84c1-c05b7ad2a59c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.316554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b3930-b7a1-4519-84c1-c05b7ad2a59c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.316838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b3930-b7a1-4519-84c1-c05b7ad2a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.335425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-781b3930-b7a1-4519-84c1-c05b7ad2a59c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:27.336628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-781b3930-b7a1-4519-84c1-c05b7ad2a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:27.340252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.341716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.342005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.342284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.343005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.344747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.379417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 55/113] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:29:27 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:27.379417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.430362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 59/114] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:27.437097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca345-c2be-4542-9805-05859b04b52b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.437391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca345-c2be-4542-9805-05859b04b52b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.437675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca345-c2be-4542-9805-05859b04b52b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.439701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 60/115] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:27.440611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bca345-c2be-4542-9805-05859b04b52b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.454609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.520515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181fa47-9186-40c1-847d-157aabd53d0f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.557178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.568008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bca345-c2be-4542-9805-05859b04b52b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.570083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e27a-067a-4b0e-a3a3-59e12c32dbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.572225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e27a-067a-4b0e-a3a3-59e12c32dbeb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.572225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e27a-067a-4b0e-a3a3-59e12c32dbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.572477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e27a-067a-4b0e-a3a3-59e12c32dbeb None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.573714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0e27a-067a-4b0e-a3a3-59e12c32dbeb None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.576418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0e27a-067a-4b0e-a3a3-59e12c32dbeb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.578116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 56/116] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:27.582628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.582628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.582628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.602620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:27.603868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:27.607504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.608055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.608342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.608622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.609469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] RBAC: Adding query filter params (role.id=70e769b176f444edb0bcb6006e3b5740, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=145c3d6f3cf14863af71421712a4465f) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:27.609787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.611242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.617893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 61/117] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/role_assignments?user.id=145c3d6f3cf14863af71421712a4465f&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=70e769b176f444edb0bcb6006e3b5740 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:27.618712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.689426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 57/118] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:27.690453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.731733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.762236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8f2e-8806-4e43-b43e-d92336e90fd9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.802243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6c2c8-f092-494a-bf4b-2396132b970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.803106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c2c8-f092-494a-bf4b-2396132b970f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.803532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c2c8-f092-494a-bf4b-2396132b970f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.803815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c2c8-f092-494a-bf4b-2396132b970f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.806630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec5d5-335b-443a-ad91-487221928cea None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.816661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6c2c8-f092-494a-bf4b-2396132b970f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e2a6c2c8-f092-494a-bf4b-2396132b970f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:27.826391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:27.827413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:27.828373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:27.830448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 62/119] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:27.831873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930cae-8e76-45ee-af1e-5313cfeca56a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.832411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930cae-8e76-45ee-af1e-5313cfeca56a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.832856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930cae-8e76-45ee-af1e-5313cfeca56a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.834295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 63/120] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:27.835130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930cae-8e76-45ee-af1e-5313cfeca56a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.839565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:27.848637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:27.849694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:27.850144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:27.850494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:27.851860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:27.853474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:27.855515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 58/121] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:27.856967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:27.960872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792265f6-0dbe-49aa-b966-634fa5c88ee5 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.965864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930cae-8e76-45ee-af1e-5313cfeca56a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:27.999244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.000033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.000393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.000744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.001647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:28.002019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.003715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096e398-54c7-47b1-8d8b-f6a4193e4ad4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.012399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.013323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 59/122] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:28.013905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.014414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.014762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.015079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.015177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.015501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.017535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:28.034474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:28.037292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:28.038612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:28.045013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:28.045845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:28.046574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:28.048934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 64/123] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:28.054529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.113110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:28.131367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 60/124] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:28.132560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.168769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329eb12-9e10-4117-9141-62cfbd031779 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.208073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.209150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.209450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.209734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/cdc4137cd0c846d48612f811124960c7/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.212067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] RBAC: Authorizing `identity:create_grant(project_id=f35f46b95f85486399f17f9fe12bcf75, user_id=cdc4137cd0c846d48612f811124960c7, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.213764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.231420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 65/125] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:28 2022] PUT /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/cdc4137cd0c846d48612f811124960c7/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:28.236232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.246624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cdc4b-4118-48a3-bff0-046f08dafc63 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.288736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.290340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.290833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.291311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.293052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.294988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.297033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 61/126] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:28.298106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.345462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:28.372607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:28.414014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f702cb-d497-4b98-94dd-6b0700976b74 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.458265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.459166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.459478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.461094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.461891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:28.462208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.463651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.466050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8b892-ed28-48a5-8c34-87633dc9f91e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.486176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 66/127] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:28.487077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.529042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.531220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.532006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.533299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.561166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:28.571228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:28.572123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:28.572865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 62/128] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:28.573506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.640815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c508e-7ac8-4278-9182-7c1f9e2d9570 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.658309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:28.690252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b1f72-ae6f-4aa0-95c4-1dc0b095ebbb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.692766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.694125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.694125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.694382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.696189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.697684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.700490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 67/129] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:28.701300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.721815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:28.730742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.733790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.734321 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.735027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.738541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.740288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.744583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 63/130] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:28.745699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.890475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b802c-e429-44cb-bcaa-ba94941995c8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:28.929323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:28.930325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:28.930828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:28.931337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:28.932496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:28.933126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:28.935329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:28.945757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 68/131] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:28.946774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:28.947295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d30c7-d495-4ce7-be18-f8109af05b5b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:29.003015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:29.031876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:29.033184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.033742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.034217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/cdc4137cd0c846d48612f811124960c7/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.038720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=f35f46b95f85486399f17f9fe12bcf75, user_id=cdc4137cd0c846d48612f811124960c7, role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:29.041844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:29.076848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 64/132] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:28 2022] PUT /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/cdc4137cd0c846d48612f811124960c7/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:29.078161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:29.129816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803652-5e4c-4a24-9d77-47be9a2ed329 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:29.168428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:29.201705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:29.202502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.202932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.203348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.206663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:29.208954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:29.210862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 69/133] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:28 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:29.218705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:29.278677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e9384-338c-4d92-b3e2-b3b85f383e7c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:29.348900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:29.350193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.350682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.351184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.356195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:29.358488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:29.360476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 65/134] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:29 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:29.363264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692d456-af8c-4771-9ed5-7b255073bafd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:29.365931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:29.384787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:29.424164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:29.425077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.425359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.425632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/8cead41321b144bab20ff36d66ca2d2a/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.427728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f35f46b95f85486399f17f9fe12bcf75, user_id=8cead41321b144bab20ff36d66ca2d2a, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:29.429170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:29.454055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 70/135] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:29 2022] PUT /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/8cead41321b144bab20ff36d66ca2d2a/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:29.529714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7c81-fdd7-4d2f-a86e-8ec6adec4365 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:29.553045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:29.582809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ff08-f06a-43d8-83df-2db3b296b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:29.584065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ff08-f06a-43d8-83df-2db3b296b10b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.584614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ff08-f06a-43d8-83df-2db3b296b10b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.585112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ff08-f06a-43d8-83df-2db3b296b10b None admin] PATH_INFO: `/v3/projects/e060ed7d1c034d099c0de453b802537b` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.589282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ff08-f06a-43d8-83df-2db3b296b10b None admin] RBAC: Authorizing `identity:get_project(project_id=e060ed7d1c034d099c0de453b802537b)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:29.591813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ff08-f06a-43d8-83df-2db3b296b10b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:29.594500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 66/136] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:29 2022] GET /identity/v3/projects/e060ed7d1c034d099c0de453b802537b => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:29.599998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:29.738925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0b96-b595-441e-b1a9-8c9ad22edfe4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:29.772989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad2857-39de-4db7-847d-367dc481fa9f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.773657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad2857-39de-4db7-847d-367dc481fa9f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.774158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad2857-39de-4db7-847d-367dc481fa9f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.775470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:29.776154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 67/137] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:29.783436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.783436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.783436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] PATH_INFO: `/v3/projects/e060ed7d1c034d099c0de453b802537b/users/cdc4137cd0c846d48612f811124960c7/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.783436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e060ed7d1c034d099c0de453b802537b, user_id=cdc4137cd0c846d48612f811124960c7, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:29.783436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:29.790241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1af1d3-2751-4329-8f90-7ade9e431629 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:29.790874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1af1d3-2751-4329-8f90-7ade9e431629 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:29.791357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1af1d3-2751-4329-8f90-7ade9e431629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:29.804612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 71/138] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:29 2022] PUT /identity/v3/projects/e060ed7d1c034d099c0de453b802537b/users/cdc4137cd0c846d48612f811124960c7/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:29.813040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4c1af1d3-2751-4329-8f90-7ade9e431629 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:29.816504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4c1af1d3-2751-4329-8f90-7ade9e431629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:29.901174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 68/139] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:29.944450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:29.983018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:30.045967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997de91-e11b-45d9-b5bc-bd8186354b9f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.046483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997de91-e11b-45d9-b5bc-bd8186354b9f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.046554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997de91-e11b-45d9-b5bc-bd8186354b9f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.048225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 69/140] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:30.057950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.058380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.058916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.072029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569d97d-9c90-437d-8543-e9a718691ac4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:30.093847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:30.095124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:30.119595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:30.120840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.121130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.121702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.124862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:30.126630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:30.129278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 72/141] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:30.134563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:30.233193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 70/142] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:30.258824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:30.275781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da01b-d1f7-4022-b719-7f57683c21fa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:30.277542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:30.326158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:30.337973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:30.338708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.338995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.339272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.340224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:30.342175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:30.381259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 73/143] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:30 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:30.435905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad71514-05fd-425b-a895-2cf47e683293 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:30.488680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:30.489507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.489802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.490083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.506900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:30.515081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:30.515962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:30.516695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 71/144] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:30.523185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:30.684006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1fdb-494d-4fcd-a8d8-fe77c7233079 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:30.731178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:30.732448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.732731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.733005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.733764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:30.734070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:30.735495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:30.747098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:30.753767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:30.912431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:30.916416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc8e3-0a87-44cf-9384-54c9a64dffed None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:30.961851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:30.962668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:30.962955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:30.963258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] PATH_INFO: `/v3/users/145c3d6f3cf14863af71421712a4465f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:30.964502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] RBAC: Authorizing `identity:get_user(user_id=145c3d6f3cf14863af71421712a4465f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:30.966609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:30.968848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:30 2022] GET /identity/v3/users/145c3d6f3cf14863af71421712a4465f => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:30.974227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:31.018335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:31.131699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce589-dc26-402d-b397-f0ca4a1a1ecb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:31.180641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9f56c-f4c1-4eac-827a-923b24fa25e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:31.181524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9f56c-f4c1-4eac-827a-923b24fa25e6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:31.181812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9f56c-f4c1-4eac-827a-923b24fa25e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:31.182088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9f56c-f4c1-4eac-827a-923b24fa25e6 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:31.183287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9f56c-f4c1-4eac-827a-923b24fa25e6 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:31.184855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9f56c-f4c1-4eac-827a-923b24fa25e6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:31.186986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 75/147] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:30 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:31.192525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:31.333612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad75e-5ca2-4a25-97f1-9763bb3910e4 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:31.374486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd68a0c-6536-4670-b71d-fca4dad5847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:31.375647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd68a0c-6536-4670-b71d-fca4dad5847b None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:31.376078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd68a0c-6536-4670-b71d-fca4dad5847b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:31.376496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd68a0c-6536-4670-b71d-fca4dad5847b None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/145c3d6f3cf14863af71421712a4465f/roles/70e769b176f444edb0bcb6006e3b5740` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:31.384188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd68a0c-6536-4670-b71d-fca4dad5847b None admin] RBAC: Authorizing `identity:create_grant(project_id=f35f46b95f85486399f17f9fe12bcf75, user_id=145c3d6f3cf14863af71421712a4465f, role_id=70e769b176f444edb0bcb6006e3b5740)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:31.385841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd68a0c-6536-4670-b71d-fca4dad5847b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:31.411462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 73/148] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:31 2022] PUT /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75/users/145c3d6f3cf14863af71421712a4465f/roles/70e769b176f444edb0bcb6006e3b5740 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:31.719787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0bab8-2662-45b0-b852-0a5df67d8309 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:31.720499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0bab8-2662-45b0-b852-0a5df67d8309 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:31.721008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0bab8-2662-45b0-b852-0a5df67d8309 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:31.722608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 76/149] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:31.728758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:31.729331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:31.729848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:31.750072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:31.751706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:31.776574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:31.811610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481cb6-aa81-4fe5-8732-f3706598a72e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:31.811923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481cb6-aa81-4fe5-8732-f3706598a72e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:31.812171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481cb6-aa81-4fe5-8732-f3706598a72e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:31.813700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 77/150] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:31.825608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:31.825892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:31.826167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:31.845453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 74/151] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:31.855657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:31.857421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:31.913683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:31.951329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 78/152] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:31.988266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.019627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:32.041381 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd52673-f79c-414b-afc8-75286f0eedb5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.086589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.087428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.087761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.088168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.102516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:32.112575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:32.113458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:32.114220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 75/153] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:32.122008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.146709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:32.165012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fe9fc-928f-4693-8684-c41779b1945b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.248040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.248866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.249205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.249501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.254142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d51a-b374-4f07-abd0-a39cf6b44070 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.273578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:32.282611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:32.283475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:32.284215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:32.288580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 79/154] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:32.291207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.292014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.292364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.292711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.293620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:32.294037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:32.294638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.295694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:32.306512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 76/155] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:32.312976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.412125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:32.436578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee823aa-008c-4731-923c-2cf4466df524 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.447126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:32.475937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.477253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.477541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.477820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.479084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:32.481195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:32.483613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 77/156] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:32.489224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.523644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db843f9e-ae11-4aa9-834a-cd40eda8b9b1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.599707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.600399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.600688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.600967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.601740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:32.602057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:32.603518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:32.609606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfedb1-e278-4d1d-b4e5-28456923c507 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.617687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 80/157] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:32.623785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.648688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.649344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.649628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.649907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.683748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:32.784627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:32.786161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:32.819773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefc2a9-a5e8-4652-b426-a9d26cc124c9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:32.886132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:32.887470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:32.888136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:32.888711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:32.896059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 78/158] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:29:32.896555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:32.898261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:32.900283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 81/159] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:32.901887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.906436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:32.925807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:32.956646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:33.011932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab822-ff8c-4af5-b35d-307f82d29e60 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:33.049546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:33.050667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.051162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.051604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.053076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:33.054887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:33.056895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 79/160] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:33.071104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:33.081376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951f62-e890-4a0f-890a-1f4caf841509 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:33.159151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:33.159832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.160113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.160390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.253150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f57a-3311-4e50-a1cd-9db0b1f17b84 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:33.274897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:33.296178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:33.297922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:33.303081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:33.304038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.304429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.304805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.305765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=cdc4137cd0c846d48612f811124960c7) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:33.306445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:33.308027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309223-22a9-41b5-924f-09216f8f8335 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:33.316338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:33.317643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 80/161] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:33 2022] GET /identity/v3/role_assignments?user.id=cdc4137cd0c846d48612f811124960c7&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:33.356708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5191-bd31-4ebd-8f07-32e6c8bc9986 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.357219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5191-bd31-4ebd-8f07-32e6c8bc9986 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.357664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5191-bd31-4ebd-8f07-32e6c8bc9986 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.359256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 81/162] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:33.364926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.365433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.365855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.400636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:33.402116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:33.488527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 82/163] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:29:33.494206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:33.558780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 82/164] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:33.605093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:33.676411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3adaa4-55d4-470e-878a-8a1369a10209 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:33.688053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:33.722910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083960b-016e-4ba5-a8e7-02249ee49768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:33.723804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083960b-016e-4ba5-a8e7-02249ee49768 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.724082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083960b-016e-4ba5-a8e7-02249ee49768 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.724358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083960b-016e-4ba5-a8e7-02249ee49768 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.728294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083960b-016e-4ba5-a8e7-02249ee49768 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:33.729768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083960b-016e-4ba5-a8e7-02249ee49768 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:33.732089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 83/165] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:33 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:33.733311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6860f-71a3-4a9e-9bb6-e3a548ce08de None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.733597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6860f-71a3-4a9e-9bb6-e3a548ce08de None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.733869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6860f-71a3-4a9e-9bb6-e3a548ce08de None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.735099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 84/166] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:33.739415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6860f-71a3-4a9e-9bb6-e3a548ce08de None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:33.815416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf9d8-1891-4832-873e-5414917bd19f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:33.834996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:33.900672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5725e-6285-4a7f-9d5a-3596728a46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:33.901479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5725e-6285-4a7f-9d5a-3596728a46aa None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.901753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5725e-6285-4a7f-9d5a-3596728a46aa None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.902024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5725e-6285-4a7f-9d5a-3596728a46aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.927072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5725e-6285-4a7f-9d5a-3596728a46aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:33.932992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6860f-71a3-4a9e-9bb6-e3a548ce08de None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4fe5725e-6285-4a7f-9d5a-3596728a46aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:33.939048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:33.939961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:33.940960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 83/167] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:33.942091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:33.942091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:33.942250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:33.979378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:33.980596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:34.024969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.025641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:34.025931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:34.026206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:34.027048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] RBAC: Adding query filter params (role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=cdc4137cd0c846d48612f811124960c7) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:34.027366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:34.029423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:34.045869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 85/168] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:33 2022] GET /identity/v3/role_assignments?user.id=cdc4137cd0c846d48612f811124960c7&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:34.046764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:34.138316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 84/169] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:34.157853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:34.185131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:34.283596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a436d-9c7a-4a2d-bb8a-b8f77be799ba None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:34.375513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.376213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:34.376483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:34.376763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:34.377528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:34.377842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:34.379239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:34.381025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:34.390234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4689e-1755-4615-ba04-f748766b068c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:34.397693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 86/170] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:34.403426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:34.460808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.461681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:34.461966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:34.462238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:34.480881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:34.489109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:34.490038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:34.490798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 85/171] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:34.498818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:34.656084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a80d3e-ae14-457c-850c-040377ff51f2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:34.659668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:34.694171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524665-0144-4626-b49e-f5dae9dec1f5 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:34.714773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.717634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:34.717917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:34.718193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] PATH_INFO: `/v3/users/8cead41321b144bab20ff36d66ca2d2a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:34.720441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] RBAC: Authorizing `identity:get_user(user_id=8cead41321b144bab20ff36d66ca2d2a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:34.721895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:34.726681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 87/172] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:34 2022] GET /identity/v3/users/8cead41321b144bab20ff36d66ca2d2a => generated 247 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:34.730060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:34.751419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.752153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:34.752658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:34.754639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:34.755424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:34.755743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:34.757127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:34.778105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 86/173] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:34.781967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:34.825053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:34.913368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c87c-9e46-45a5-943f-7e43d5bb029d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:34.930508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e94bb-4c2d-4d13-adc5-7d441b4e79bf None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:34.966610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e273168-ec14-4b1a-a32c-98e5eceed057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.970399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e273168-ec14-4b1a-a32c-98e5eceed057 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:34.971025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e273168-ec14-4b1a-a32c-98e5eceed057 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:34.972406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e273168-ec14-4b1a-a32c-98e5eceed057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:34.998761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:34.999926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.000371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.000790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] PATH_INFO: `/v3/users/cdc4137cd0c846d48612f811124960c7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.002829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4137cd0c846d48612f811124960c7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.004543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.006521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 87/174] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:34 2022] GET /identity/v3/users/cdc4137cd0c846d48612f811124960c7 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:35.013406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:35.043792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.087190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e273168-ec14-4b1a-a32c-98e5eceed057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.088970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e273168-ec14-4b1a-a32c-98e5eceed057 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.137551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.149464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828981c-4364-4019-aa0f-273fb484f3a5 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:35.198362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e799194-b4da-43ad-8620-e3d3f557cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:35.198937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799194-b4da-43ad-8620-e3d3f557cf7f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.199219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799194-b4da-43ad-8620-e3d3f557cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.200781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799194-b4da-43ad-8620-e3d3f557cf7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.278490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 88/175] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:35.279865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd61852-d657-44b8-b3f3-49b52fcc5124 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.280151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd61852-d657-44b8-b3f3-49b52fcc5124 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.280423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd61852-d657-44b8-b3f3-49b52fcc5124 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.282101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 89/176] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:35.288269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd61852-d657-44b8-b3f3-49b52fcc5124 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:35.304970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e799194-b4da-43ad-8620-e3d3f557cf7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.308053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e799194-b4da-43ad-8620-e3d3f557cf7f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.395215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.431471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd61852-d657-44b8-b3f3-49b52fcc5124 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:35.449839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.461065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 88/177] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:35.463579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.463871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.464154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.480829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd4ea-2135-4f9d-8ac7-dffa65c1ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:35.482605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd4ea-2135-4f9d-8ac7-dffa65c1ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.483084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd4ea-2135-4f9d-8ac7-dffa65c1ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.483580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd4ea-2135-4f9d-8ac7-dffa65c1ef35 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.484120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:35.485197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbd4ea-2135-4f9d-8ac7-dffa65c1ef35 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.485452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:35.487067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbd4ea-2135-4f9d-8ac7-dffa65c1ef35 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.491532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 90/178] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:35 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:35.493010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9742f8-9aa1-47ae-88d0-139b29abeb78 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.493505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9742f8-9aa1-47ae-88d0-139b29abeb78 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.493981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9742f8-9aa1-47ae-88d0-139b29abeb78 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.495455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 91/179] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:35.496326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9742f8-9aa1-47ae-88d0-139b29abeb78 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:35.583417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 89/180] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:35.583417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:35.634218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9742f8-9aa1-47ae-88d0-139b29abeb78 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:35.666852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64544f-07d2-4ee7-a1bd-03b0b6fed9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:35.667738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64544f-07d2-4ee7-a1bd-03b0b6fed9ba None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.668018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64544f-07d2-4ee7-a1bd-03b0b6fed9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.668291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64544f-07d2-4ee7-a1bd-03b0b6fed9ba None admin] PATH_INFO: `/v3/projects/e060ed7d1c034d099c0de453b802537b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.669976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64544f-07d2-4ee7-a1bd-03b0b6fed9ba None admin] RBAC: Authorizing `identity:get_project(project_id=e060ed7d1c034d099c0de453b802537b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.671439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64544f-07d2-4ee7-a1bd-03b0b6fed9ba None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.673126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 92/181] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:35 2022] GET /identity/v3/projects/e060ed7d1c034d099c0de453b802537b => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:35.674244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080c84-aafb-4222-b16e-f70b61886cf4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.674527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080c84-aafb-4222-b16e-f70b61886cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.674801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080c84-aafb-4222-b16e-f70b61886cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.685385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1d767-64b6-47e5-805b-e1079e73c0fe None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:35.687072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.693455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-45080c84-aafb-4222-b16e-f70b61886cf4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:35.694636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-45080c84-aafb-4222-b16e-f70b61886cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:35.705582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.720262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:35.720908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.721182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.721460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.722283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=8cead41321b144bab20ff36d66ca2d2a) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:35.722587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.724051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839b9de-f1f7-4d78-ad45-ee6a2df811dd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.729655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 90/182] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:35 2022] GET /identity/v3/role_assignments?user.id=8cead41321b144bab20ff36d66ca2d2a&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:35.730820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7ee3-17fe-438e-b539-07af0d0d480b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.731104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7ee3-17fe-438e-b539-07af0d0d480b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.731452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7ee3-17fe-438e-b539-07af0d0d480b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.735521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 91/183] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:35.735521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7ee3-17fe-438e-b539-07af0d0d480b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:35.772146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 93/184] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:35.773516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1c4e-c672-40bd-8501-8b3d183d7092 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.773804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1c4e-c672-40bd-8501-8b3d183d7092 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.774076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1c4e-c672-40bd-8501-8b3d183d7092 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.775945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 94/185] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:35.776049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d1c4e-c672-40bd-8501-8b3d183d7092 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:35.875112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7ee3-17fe-438e-b539-07af0d0d480b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:35.900432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d1c4e-c672-40bd-8501-8b3d183d7092 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:35.912703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608cea7-de3e-48df-8b9c-1146000c90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:35.913504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608cea7-de3e-48df-8b9c-1146000c90d7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.913789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608cea7-de3e-48df-8b9c-1146000c90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.914066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608cea7-de3e-48df-8b9c-1146000c90d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.925885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608cea7-de3e-48df-8b9c-1146000c90d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-f608cea7-de3e-48df-8b9c-1146000c90d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:35.934357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:35.935491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:35.936239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 92/186] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:35.937331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.937671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.937897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.945487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:35.946153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.946447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.946722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.947602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=e060ed7d1c034d099c0de453b802537b, user.id=cdc4137cd0c846d48612f811124960c7) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:35.947919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:35.949380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6576078-a961-4f6f-a54f-9a488f00f8fb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:35.955082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:35.958813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 95/187] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:35 2022] GET /identity/v3/role_assignments?user.id=cdc4137cd0c846d48612f811124960c7&scope.project.id=e060ed7d1c034d099c0de453b802537b&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:35.959752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:35.960964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:35.967803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:35.968165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:35.968432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:35.993345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:35.994579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:36.021497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.053872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 93/188] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:36.054691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.093632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 96/189] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:36.095073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.184279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939eb8-9999-42bf-b718-f5713113d12a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.214515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13380-fcbd-4691-8384-3f97f6033d02 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.220430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.221233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.221517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.221795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.232367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:36.241735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:36.242773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:36.243611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 94/190] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:36.244231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.245693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.253378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.254468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.254750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.255024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.256165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:36.256478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.257859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.270527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 97/191] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:36.270527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.279012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.346390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d7160-eb10-4ff6-9787-2e24d6cf3f3a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.365266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982f680-4e5e-46f4-b20c-e26ac2887ab6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.380483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.381273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.381557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.381832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.383026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.384527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.386152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 95/192] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:36.386984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.401010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.401814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.402097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.402370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.412446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:36.421030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:36.422094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 98/193] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:36.423085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.478268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.489028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed39aa2-3660-4196-a7f9-07b3d58f34c7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.490511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.522762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.523449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.523744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.524020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.524779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:36.525091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.525652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9b883-1d74-48ce-ad25-a56480b3562e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.526489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.535698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 96/194] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:36.536466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.560783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.561661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.561941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.562210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] PATH_INFO: `/v3/users/145c3d6f3cf14863af71421712a4465f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.563406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] RBAC: Authorizing `identity:get_user(user_id=145c3d6f3cf14863af71421712a4465f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.564853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.566619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 99/195] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/users/145c3d6f3cf14863af71421712a4465f => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:36.567219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.634371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de9dc-532f-44cc-9a71-49cbb6331bf9 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.665469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf3b5-6c6b-4304-82c0-bde704767017 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.667998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.668441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.668570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.668838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.670097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.671562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.685743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.697185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 97/196] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:36 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:36.700625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.701299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.701582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.701858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.702624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:36.702937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.704387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.704514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.714078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 100/197] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:36.714774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.729046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.818883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837802-e6ba-476d-b716-fa00d46afdbc None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.837739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b43d9-942f-4cfd-a2b9-0ba00cd3af4d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:36.858715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.859802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.860088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.860424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] PATH_INFO: `/v3/users/486fdc8f11a9411a91f3662a4c0af956` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.875595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] RBAC: Authorizing `identity:get_user(user_id=486fdc8f11a9411a91f3662a4c0af956)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.875859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:36.876482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:36.876764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:36.877439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:36.877538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.879946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 98/198] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/users/486fdc8f11a9411a91f3662a4c0af956 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:36.879946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:36.938641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:36.961719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:36.963191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:36.979210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.005592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6789e4-b875-4023-9fe0-9ec2ac7c224d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.049018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.049904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.050182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.050451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] PATH_INFO: `/v3/users/486fdc8f11a9411a91f3662a4c0af956` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.052455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] RBAC: Authorizing `identity:get_user(user_id=486fdc8f11a9411a91f3662a4c0af956)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.055516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.057465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 99/199] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/users/486fdc8f11a9411a91f3662a4c0af956 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:37.058540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.090567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 101/200] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:37.092099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.175608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.188510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b6736-3fc8-4081-b560-1bda096082bb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.194451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef78914-f0ca-4033-9d8b-9af2e3f16b43 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.231970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.232759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.233054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.233331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.237778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.238692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.239192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.239985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.258813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.305434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.306941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.320869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.322779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.399763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.409488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 102/201] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:37.410395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.432313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 100/202] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:37.438131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.487002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.510730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e720-ebd9-402f-b578-731a32960a2d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.547576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277548da-e94f-4305-bce5-777e9efd17f4 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.561019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.562064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.562490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.562907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.564416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.566109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.570340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 103/203] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:37.571268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.586801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.587737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.588025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.588300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.589491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.590986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.593066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 101/204] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:37.594200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.629428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.676799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd35740-235f-42b3-8e1d-ae88ae7a0f46 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.699485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17530-445f-4145-a680-a072e338fc79 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.712740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.713873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.714348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.714811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.715479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.716748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.718398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.720901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 104/205] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:37.721844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.743341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.744487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.744964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.745747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.747149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] RBAC: Adding query filter params (role.id=70e769b176f444edb0bcb6006e3b5740, scope.project.id=f35f46b95f85486399f17f9fe12bcf75, user.id=145c3d6f3cf14863af71421712a4465f) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:37.748354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.750293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.758219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 102/206] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/role_assignments?user.id=145c3d6f3cf14863af71421712a4465f&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=70e769b176f444edb0bcb6006e3b5740 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:37.759544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:37.911746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a84f-1ccb-4717-8663-e5574297be7d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:37.931431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:37.957018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:37.958057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:37.958565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:37.959048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:37.960125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] RBAC: Adding query filter params (role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=486fdc8f11a9411a91f3662a4c0af956) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:37.960653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:37.962310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddad63-24a1-484f-8eb6-c9db9a9860b2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:37.969786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 105/207] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/role_assignments?user.id=486fdc8f11a9411a91f3662a4c0af956&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:37.975246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe5463-d2c6-4a0d-a8c3-04cf2a4362b7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:38.016938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:38.018146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:38.018632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:38.019105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:38.020190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=486fdc8f11a9411a91f3662a4c0af956) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:38.020710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:38.022419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496844-93ae-4d19-922b-7c6bc1ab528c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:38.032370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 103/208] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:37 2022] GET /identity/v3/role_assignments?user.id=486fdc8f11a9411a91f3662a4c0af956&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:38.922593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e671-d37e-41fb-868e-f2d4196c9090 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:38.923453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e671-d37e-41fb-868e-f2d4196c9090 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:38.923915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e671-d37e-41fb-868e-f2d4196c9090 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:38.925697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 106/209] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:38.931163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:38.931988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:38.932466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:38.950945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:38.952440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:38.957486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b708-67cf-445d-a9a4-b5fc3ee4791d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:38.957999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b708-67cf-445d-a9a4-b5fc3ee4791d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:38.958474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b708-67cf-445d-a9a4-b5fc3ee4791d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:38.960110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 107/210] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:38.968256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:38.968760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:38.969486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:38.988777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:38.990269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:38.990722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:39.027491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 104/211] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:39.046967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:39.070265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 108/212] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:39.101004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:39.168522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3134176-731f-49aa-96bf-09dc47a5c13b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:39.209115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:39.209836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:39.210110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:39.210375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:39.225470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:39.230768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a233f-c789-47bd-94d4-e307cec31c71 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:39.236582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:39.237451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:39.238199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:39.246049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 105/213] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:39.246829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:39.251643 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:39.277594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:39.278994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:39.279279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:39.279593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:39.281186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:39.282922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:39.285668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 109/214] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:39.290694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:39.315757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:39.362410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6951d-f06b-4c2e-a853-dc1fa9e015c2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:39.396053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fce20-406e-4b34-b9e4-fe4466109386 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:39.396538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:39.397205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:39.397488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:39.397766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:39.398519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:39.398827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:39.400245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:39.409366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 106/215] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:39.415108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:39.437668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:39.438753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:39.439238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:39.439730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:39.440650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:39.442362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:39.471460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 110/216] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:39 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:29:39.530676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:39.540104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff793ee-da4c-4448-aa17-2bc3ef08d33c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:39.580130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:39.581036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:39.581324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:39.581602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] PATH_INFO: `/v3/users/c746273147da4ad994f3589f1e93f39a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:39.597464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] RBAC: Authorizing `identity:get_user(user_id=c746273147da4ad994f3589f1e93f39a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:39.598954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:39.600872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 107/217] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:39 2022] GET /identity/v3/users/c746273147da4ad994f3589f1e93f39a => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:39.606718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:39.649343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:39.722800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa317-def3-4e22-8033-cbd51afe7be3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:39.759616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d3d4e-9110-4bf9-9fe1-e6241ecd02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:39.760619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d3d4e-9110-4bf9-9fe1-e6241ecd02d5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:39.761044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d3d4e-9110-4bf9-9fe1-e6241ecd02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:39.761462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d3d4e-9110-4bf9-9fe1-e6241ecd02d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:39.842791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d3d4e-9110-4bf9-9fe1-e6241ecd02d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:39.844572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d3d4e-9110-4bf9-9fe1-e6241ecd02d5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:39.889156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:39.962005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 111/218] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:39.967579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.072696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e131-fb88-4251-bdd1-e27a556e910f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.073047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e131-fb88-4251-bdd1-e27a556e910f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.073260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e131-fb88-4251-bdd1-e27a556e910f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.074728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 112/219] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:40.075553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74afef1-3e11-4a12-bb45-a395b31dcf2e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:40.081716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.082118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.082495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.103164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:40.104493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:40.127068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632f89b-c5bc-4128-8799-41f7da764005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:40.127986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f89b-c5bc-4128-8799-41f7da764005 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.128269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f89b-c5bc-4128-8799-41f7da764005 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.128543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f89b-c5bc-4128-8799-41f7da764005 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.129738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632f89b-c5bc-4128-8799-41f7da764005 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:40.131426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632f89b-c5bc-4128-8799-41f7da764005 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:40.136553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 108/220] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:39 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:40.136553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd7bcb-b5fd-421f-8f4f-ee75c594a114 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.136553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd7bcb-b5fd-421f-8f4f-ee75c594a114 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.136553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd7bcb-b5fd-421f-8f4f-ee75c594a114 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.136553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 109/221] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:40.141673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.141959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.142237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.160859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:40.162055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:40.178756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:40.188070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 113/222] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:40.195684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.261744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 110/223] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:40.271809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.291414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:40.330950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735fbeb-c8c7-4ed3-b431-523030b08a98 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:40.367652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:40.368316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.368595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.368867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.369813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=c746273147da4ad994f3589f1e93f39a) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:40.370128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:40.371876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:40.377957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 114/224] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/role_assignments?user.id=c746273147da4ad994f3589f1e93f39a&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:40.378681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.415751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bdd00-f400-4dcf-8777-a9f4c09515d1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:40.490726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:40.492336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.492615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.492883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.517989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:40.534348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:40.535466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:40.536363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:40.537048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 111/225] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:40.544095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.571437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:40.580447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cf81f-cc51-4b87-b516-babf11b3f199 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:40.616518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:40.624831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:40.625887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.626355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.626808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.638047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:40.646590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:40.647472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:40.648231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:40.650700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 115/226] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:40.659081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.733744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0f51-9522-414f-bdfe-a86fcbecfc79 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:40.791084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:40.791799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.792084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.792364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.793120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:40.793428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:40.795836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:40.805196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 112/227] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:40.811051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.832428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6edaf8-a097-46e1-a23d-26216577a7ae None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:40.893991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:40.894582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:40.894864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:40.895134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:40.895918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:40.896221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:40.897605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:40.915683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 116/228] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:40.921884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:40.955781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:40.994390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3f958-6305-4704-b0ea-c2eff7c42f0d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:41.034491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:41.061219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:41.062251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.062534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.062807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] PATH_INFO: `/v3/users/486fdc8f11a9411a91f3662a4c0af956` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.064972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] RBAC: Authorizing `identity:get_user(user_id=486fdc8f11a9411a91f3662a4c0af956)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:41.068042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:41.070538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 113/229] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/users/486fdc8f11a9411a91f3662a4c0af956 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:41.076069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:41.171825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be93db-052e-42b7-b32f-042c3c8c95f0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:41.221439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:41.222375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.222663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.222942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] PATH_INFO: `/v3/users/486fdc8f11a9411a91f3662a4c0af956` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.226403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] RBAC: Authorizing `identity:get_user(user_id=486fdc8f11a9411a91f3662a4c0af956)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:41.227901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:41.237482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 117/230] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:40 2022] GET /identity/v3/users/486fdc8f11a9411a91f3662a4c0af956 => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:41.246147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a92b-d918-4b2a-ad5c-4fe2f73d65a7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:41.251283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:41.310788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:41.311754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.312042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.312364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.313574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:41.315020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:41.317222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 114/231] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:41 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:41.324409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:41.355778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:41.447659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c46df-8b21-4997-82f2-78ce2d489ed6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:41.494658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201e3a2-014f-403a-80bd-8169cfcd2f01 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:41.507813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:41.508711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.508982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.509256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a/users/486fdc8f11a9411a91f3662a4c0af956/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.513925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6da87e604181436c81ef188a81ee128a, user_id=486fdc8f11a9411a91f3662a4c0af956, role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:41.515423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:41.537054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:41.539831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 115/232] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:41 2022] PUT /identity/v3/projects/6da87e604181436c81ef188a81ee128a/users/486fdc8f11a9411a91f3662a4c0af956/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:41.552863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f667ea-71a6-43c5-bbf1-3649898a50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:41.553876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f667ea-71a6-43c5-bbf1-3649898a50c3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.554207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f667ea-71a6-43c5-bbf1-3649898a50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.554486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f667ea-71a6-43c5-bbf1-3649898a50c3 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.555739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f667ea-71a6-43c5-bbf1-3649898a50c3 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:41.557254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f667ea-71a6-43c5-bbf1-3649898a50c3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:41.559412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 118/233] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:41 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:41.567658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:41.675735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:41.717927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d90cc6-3678-4067-99a5-2ba977c4c4a0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:41.758481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824264e3-2fba-4e20-9b4d-608597ca2b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:41.759417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824264e3-2fba-4e20-9b4d-608597ca2b38 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.759721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824264e3-2fba-4e20-9b4d-608597ca2b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.760066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824264e3-2fba-4e20-9b4d-608597ca2b38 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a/users/486fdc8f11a9411a91f3662a4c0af956/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.762249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824264e3-2fba-4e20-9b4d-608597ca2b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=6da87e604181436c81ef188a81ee128a, user_id=486fdc8f11a9411a91f3662a4c0af956, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:41.764370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824264e3-2fba-4e20-9b4d-608597ca2b38 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:41.784825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 116/234] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:41 2022] PUT /identity/v3/projects/6da87e604181436c81ef188a81ee128a/users/486fdc8f11a9411a91f3662a4c0af956/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:41.915625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a215c-9326-4140-a24e-aa950a500fd6 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.915976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a215c-9326-4140-a24e-aa950a500fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.916188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a215c-9326-4140-a24e-aa950a500fd6 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.917902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 119/235] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:41.924075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:41.924358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:41.924644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:41.946515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:41.947841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:42.031347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 117/236] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:42.060127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a215c-9326-4140-a24e-aa950a500fd6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:42.196638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a215c-9326-4140-a24e-aa950a500fd6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:42.242998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27089f-3c59-43fa-99d8-79846daf568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:42.243897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27089f-3c59-43fa-99d8-79846daf568c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.244179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27089f-3c59-43fa-99d8-79846daf568c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.244453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27089f-3c59-43fa-99d8-79846daf568c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.257218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27089f-3c59-43fa-99d8-79846daf568c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9e27089f-3c59-43fa-99d8-79846daf568c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:42.268017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:42.268893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:42.269659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 120/237] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:42.275268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:42.319087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f848d-901e-4546-a2e1-2a53aa2808b7 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.319380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f848d-901e-4546-a2e1-2a53aa2808b7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.319592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f848d-901e-4546-a2e1-2a53aa2808b7 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.321906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 121/238] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:42.329430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.329648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.329917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.352002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:42.353681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:42.397245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:42.409272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:42.452033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 122/239] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:42.480107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:42.485141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4afd-b994-4817-bc1b-274b33482cb3 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:42.561868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:42.562544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.562822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.563099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.565291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:42.565605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:42.566995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:42.587812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 118/240] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:42.592000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:42.672762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f5c6e-728f-4862-aa69-344c47abb9f2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:42.738137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:42.738938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.739428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.739915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.741226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:42.742816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:42.745362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 123/241] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:42.750858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:42.787700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d5cc-877c-4874-b642-75547900dd1b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:42.808808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:42.824833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307e418-3c7f-4283-b407-6da66190738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:42.826273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:42.826615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307e418-3c7f-4283-b407-6da66190738e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.827065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307e418-3c7f-4283-b407-6da66190738e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.827520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307e418-3c7f-4283-b407-6da66190738e None admin] PATH_INFO: `/v3/users/b537b7ce35c44cc2b514cf1b3ff1039f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.842336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307e418-3c7f-4283-b407-6da66190738e None admin] RBAC: Authorizing `identity:get_user(user_id=b537b7ce35c44cc2b514cf1b3ff1039f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:42.844361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307e418-3c7f-4283-b407-6da66190738e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:42.846276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 119/242] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:42 2022] GET /identity/v3/users/b537b7ce35c44cc2b514cf1b3ff1039f => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:42.847757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c8d47-90db-496d-bc78-5173070c000d None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.848249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c8d47-90db-496d-bc78-5173070c000d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.848725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c8d47-90db-496d-bc78-5173070c000d None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.850189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 120/243] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:42.855116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c8d47-90db-496d-bc78-5173070c000d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:42.890748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0bc8-d339-462f-a7f0-28fa96bfcd63 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:42.925728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9028-03f9-4790-a46f-6d5ea03e27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:42.926739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9028-03f9-4790-a46f-6d5ea03e27c3 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.927164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9028-03f9-4790-a46f-6d5ea03e27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.927627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9028-03f9-4790-a46f-6d5ea03e27c3 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.928563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9028-03f9-4790-a46f-6d5ea03e27c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:42.930219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9028-03f9-4790-a46f-6d5ea03e27c3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:42.962026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 124/244] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:42 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:29:42.963897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:42.964414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:42.964862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:42.975105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c8d47-90db-496d-bc78-5173070c000d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.004630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:43.006121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:43.016482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.016482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.017033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.017405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.089633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 125/245] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:43.116036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.147075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:43.151941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:43.221148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:43.222649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:43.239310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972bdc1-5c80-4afb-b96a-f0869023a18d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.284897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.286575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.287078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.287810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.303753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:43.312416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:43.313290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:43.314070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:43.322764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 126/246] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:43.323913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.360688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 121/247] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:43.366732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.448408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:43.461362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80f8e-ed0c-44a5-bec7-84e5b6dba6be None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.475790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:43.500521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.501352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.501736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.501956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e37a-ace3-4f89-9f48-821c8ead6c35 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.502195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.503064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:43.503594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:43.506394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:43.516252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 127/248] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:43.522065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.559275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.561101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.561632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.562105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.563724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:43.566154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:43.568619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 122/249] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:43 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:43.576717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.686144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a006-a44c-43d1-96ef-8ba07fe7321c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.719870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dea0-817e-49fa-843e-17ff8641a327 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.733625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.734523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.734811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.735089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] PATH_INFO: `/v3/users/c746273147da4ad994f3589f1e93f39a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.736610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] RBAC: Authorizing `identity:get_user(user_id=c746273147da4ad994f3589f1e93f39a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:43.738628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:43.741057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 128/250] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:43 2022] GET /identity/v3/users/c746273147da4ad994f3589f1e93f39a => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:43.746716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.763265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.764004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.764747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.765032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.766304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] RBAC: Adding query filter params (role.id=70e769b176f444edb0bcb6006e3b5740, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=b537b7ce35c44cc2b514cf1b3ff1039f) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:43.766895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:43.768670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:43.779489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 123/251] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:43 2022] GET /identity/v3/role_assignments?user.id=b537b7ce35c44cc2b514cf1b3ff1039f&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=70e769b176f444edb0bcb6006e3b5740 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:43.793838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:43.903466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950af17-b4dd-4c91-8805-261a3e859887 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:43.947434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5afd5-5db6-4d34-b137-24671131472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:43.948236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5afd5-5db6-4d34-b137-24671131472a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:43.948516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5afd5-5db6-4d34-b137-24671131472a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:43.948791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5afd5-5db6-4d34-b137-24671131472a None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:43.950239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5afd5-5db6-4d34-b137-24671131472a None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:43.952279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5afd5-5db6-4d34-b137-24671131472a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:43.954155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 129/252] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:43 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:43.960051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:43.974019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:44.023198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea3826-e2b5-44e1-952e-ab94d8ef515f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.023544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea3826-e2b5-44e1-952e-ab94d8ef515f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.023789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea3826-e2b5-44e1-952e-ab94d8ef515f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.026568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 130/253] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:44.041394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64656-f0ba-4c51-b0a2-a074ed5a1869 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.042017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64656-f0ba-4c51-b0a2-a074ed5a1869 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.042517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64656-f0ba-4c51-b0a2-a074ed5a1869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.086176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a0e64656-f0ba-4c51-b0a2-a074ed5a1869 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:44.086176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a0e64656-f0ba-4c51-b0a2-a074ed5a1869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:44.140931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1457b44-127e-4727-8a92-4608be5b3905 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:44.180973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 131/254] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:44.182772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f29c-0f09-4c24-9e8e-2a8f2ab810dc None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.183068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f29c-0f09-4c24-9e8e-2a8f2ab810dc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.183353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f29c-0f09-4c24-9e8e-2a8f2ab810dc None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.185345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 132/255] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:44.190935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.191229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.191539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.203125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:44.204729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.205228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.205733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a/users/c746273147da4ad994f3589f1e93f39a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.211453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:44.213010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=6da87e604181436c81ef188a81ee128a, user_id=c746273147da4ad994f3589f1e93f39a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:44.213127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:44.214833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:44.230067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:44.249237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 124/256] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:43 2022] PUT /identity/v3/projects/6da87e604181436c81ef188a81ee128a/users/c746273147da4ad994f3589f1e93f39a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:44.251140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:44.334106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 133/257] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:44.375189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:44.417676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf84f7d-da08-48d0-ba88-7354c0cf3c66 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:44.425545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:44.493737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:44.494858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.495287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.495755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.519545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:44.531430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:44.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:44.533524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:44.538793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 125/258] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:44.543699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:44.602794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85905-ab57-4150-84b7-24ed9eb745a9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:44.648292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:44.649121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.649407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.649685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.672051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:44.680606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:44.681463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:44.682217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 134/259] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:44.688509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:44.691280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f76f-ecd1-41e5-ae21-db1fd673fb6c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:44.709524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:44.721318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:44.734207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:44.734883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.735175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.740079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.741064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:44.741441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:44.742834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:44.760501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 126/260] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:44.767561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:44.838511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762da61-f219-4ef8-bd28-68b2659c0919 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:44.904802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:44.905539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:44.905826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:44.906100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:44.906867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:44.907180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:44.908916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:44.923745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 135/261] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:44.929588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:45.022777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:45.028073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc979-6380-4706-8e8a-1e5c0c015b34 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.060770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3a18-fac0-43b7-891b-abbc14fb38d8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.125186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:45.126100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:45.126387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:45.126655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] PATH_INFO: `/v3/users/486fdc8f11a9411a91f3662a4c0af956` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:45.128009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] RBAC: Authorizing `identity:get_user(user_id=486fdc8f11a9411a91f3662a4c0af956)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:45.129718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:45.131476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 127/262] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:44 2022] GET /identity/v3/users/486fdc8f11a9411a91f3662a4c0af956 => generated 283 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:45.137287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:45.143860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:45.145728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:45.146018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:45.146298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] PATH_INFO: `/v3/users/486fdc8f11a9411a91f3662a4c0af956` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:45.148344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] RBAC: Authorizing `identity:get_user(user_id=486fdc8f11a9411a91f3662a4c0af956)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:45.150348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:45.152137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 136/263] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:44 2022] GET /identity/v3/users/486fdc8f11a9411a91f3662a4c0af956 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:45.165182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:45.255761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:45.332481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfef82-c4b3-4bf3-a169-fa8563d6ab1f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.349128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477290-d654-4088-84ea-f1d6b24e1c03 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.371412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:45.371412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:45.371412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:45.371412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:45.381199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:45.411130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:45.412071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:45.412501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:45.413056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:45.442120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:45.443768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:45.543736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:45.545720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:45.557791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 137/264] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:45.567148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:45.610646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:45.672537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12047-0e0a-431d-ad2d-8d63650ede95 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.684382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:45.741413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:45.742290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:45.742573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:45.742865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:45.744778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:45.746235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:45.748529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 138/265] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:45 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:45.759578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:45.795096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 128/266] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:29:45.801908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:45.966581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784343-416d-4008-b8d6-b678d296c211 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.969780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cd350-0d5f-4906-a33d-34d72390dd55 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:45.987959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:46.023251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:46.024465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.024897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.025327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.026673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:46.028353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:46.031215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 129/267] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:45 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:46.037286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:46.061226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:46.062331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.063872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.064323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.065363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] RBAC: Adding query filter params (role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=486fdc8f11a9411a91f3662a4c0af956) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:46.067322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:46.069031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6161-7aa0-489d-886f-439920ec0043 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:46.082944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 139/268] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:45 2022] GET /identity/v3/role_assignments?user.id=486fdc8f11a9411a91f3662a4c0af956&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:46.103791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:46.214502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6050d3-c1e8-4ff7-9010-b658e8da643f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:46.227381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff4a17-ce0f-4200-b181-ff9ef56032ec None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.227705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff4a17-ce0f-4200-b181-ff9ef56032ec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.227906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff4a17-ce0f-4200-b181-ff9ef56032ec None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.234139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 140/269] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:46.235876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd958ae-98fd-4a32-aacc-840a50f84747 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.236174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd958ae-98fd-4a32-aacc-840a50f84747 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.236457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd958ae-98fd-4a32-aacc-840a50f84747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.276688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4cd958ae-98fd-4a32-aacc-840a50f84747 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:46.278112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4cd958ae-98fd-4a32-aacc-840a50f84747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:46.302925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:46.304428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.304977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.305956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.307170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=486fdc8f11a9411a91f3662a4c0af956) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:46.307723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:46.309782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:46.321710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 130/270] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:46 2022] GET /identity/v3/role_assignments?user.id=486fdc8f11a9411a91f3662a4c0af956&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:46.393503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 141/271] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:46.421196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:46.503432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e7ef-550a-4022-980d-be4b2472b8a7 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.504054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e7ef-550a-4022-980d-be4b2472b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.504534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e7ef-550a-4022-980d-be4b2472b8a7 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.506129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 142/272] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:46.513317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.513606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.513885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.557904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:46.559221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:46.567621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:46.577722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392b29-ffcc-43e0-a454-338f2b978d4a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:46.619004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:46.620133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.620614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.621072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.622469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:46.624145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:46.626274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 131/273] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:46.631606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:46.650117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 143/274] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:46.678625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:46.717957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:46.770084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68582f9-08c3-4c9d-b1ef-2f90ff93c9c9 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:46.818301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:46.819227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.819567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.819850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.820575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:46.821769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3dd1-e7ba-41d1-8760-6eaed55840fd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:46.822030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:46.853619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 132/275] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:29:46 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:29:46.869687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:46.870880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:46.871333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:46.871799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:46.885771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:46.895107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:46.896254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:46.897191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:46.899845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 144/276] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:46.907473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:46.927993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:47.026226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbfa98-cce6-4bbc-9e01-fc93b6f058b0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.060899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:47.061579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.061854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.062136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.062903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:47.063207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:47.064622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdd49c-1d51-4a6a-b24b-5fa03930dc77 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:47.073860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 133/277] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:47.079947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:47.183380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:47.193745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1a14-ce57-4b18-bd94-328820554f50 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.237319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:47.237517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb992f2-a90f-4c08-b556-218e5b043c49 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.237858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb992f2-a90f-4c08-b556-218e5b043c49 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.238164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb992f2-a90f-4c08-b556-218e5b043c49 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.238410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.238667 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.238946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] PATH_INFO: `/v3/users/d7a94448f3e9490daeb8b7c1e12044ee` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.242680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 134/278] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:47.248048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6db4aa-f776-4be9-b285-7f33bd33fda5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.248688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6db4aa-f776-4be9-b285-7f33bd33fda5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.249177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6db4aa-f776-4be9-b285-7f33bd33fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.265192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] RBAC: Authorizing `identity:get_user(user_id=d7a94448f3e9490daeb8b7c1e12044ee)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:47.267060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:47.269664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 145/279] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:47 2022] GET /identity/v3/users/d7a94448f3e9490daeb8b7c1e12044ee => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:47.279859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:47.281478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cb6db4aa-f776-4be9-b285-7f33bd33fda5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:47.283259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cb6db4aa-f776-4be9-b285-7f33bd33fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:47.384824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 135/280] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:47.384824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19296fd0-e4d9-4ceb-b426-4c3b06c332cc None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.384824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19296fd0-e4d9-4ceb-b426-4c3b06c332cc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.384824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19296fd0-e4d9-4ceb-b426-4c3b06c332cc None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.384824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 136/281] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:47.390091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.390427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.390708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.410270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:47.411501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:47.413948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:47.417022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c9fe-23f4-4ff7-a300-19d87c90bb8e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.457844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:47.458508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.458798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.459070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.460200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, user.id=d7a94448f3e9490daeb8b7c1e12044ee, scope.system=all) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:47.460310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:47.461762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:47.471869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 146/282] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Jul 25 08:29:47 2022] GET /identity/v3/role_assignments?user.id=d7a94448f3e9490daeb8b7c1e12044ee&scope.system=all&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:47.472880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:47.500856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 137/283] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:47.504535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:47.531514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:47.652604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619c6d-eefe-4522-81f7-5848f1e75e9c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.677524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1da85-9216-48d8-be13-4416be9e3496 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.695978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:47.696806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.697091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.697367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.709231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:47.717877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:47.718780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:47.719848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 147/284] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:47.726214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:47.757346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:47.758447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.758743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:47.759019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:47.774648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:47.783733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:47.788053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:47.792113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:47.792870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 138/285] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:47.803411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:47.885746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:47.939332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0fc90-3b1b-486d-9504-d2b369e8d3f2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.953550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7b73-68b5-4ddc-8980-5bfda81936cf None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:47.998790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:47.999536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:47.999917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.000141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.000862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:48.001169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.002555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.018266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 139/286] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:48.020278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.021017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.021306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.021582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.022347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:48.022656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.024103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.026162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:48.042036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 148/287] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:48.049435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:48.132015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:48.207952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd054-bf46-4ebc-bcdc-c12ec9c676b2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:48.237747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e992355-b234-4880-8ad0-0618fa094dad None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:48.280346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.281239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.281520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.281796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] PATH_INFO: `/v3/users/b537b7ce35c44cc2b514cf1b3ff1039f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.283897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] RBAC: Authorizing `identity:get_user(user_id=b537b7ce35c44cc2b514cf1b3ff1039f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.285386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.288423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 140/288] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:48 2022] GET /identity/v3/users/b537b7ce35c44cc2b514cf1b3ff1039f => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:48.297117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:48.304498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.305383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.305670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.305944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] PATH_INFO: `/v3/users/c746273147da4ad994f3589f1e93f39a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.307135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] RBAC: Authorizing `identity:get_user(user_id=c746273147da4ad994f3589f1e93f39a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.308743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.310725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 149/289] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:48 2022] GET /identity/v3/users/c746273147da4ad994f3589f1e93f39a => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:48.316486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:48.320320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:48.481189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa11b5-2607-4836-a111-5afd9d31adcd None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:48.526407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916ba3-4495-4173-b6c9-a4319cf20813 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:48.535409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:48.543130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.544313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.547521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.547780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.550781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.551602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.553365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 141/290] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:48 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:48.560794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:48.580348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.580998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.581349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.581810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.652591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.654108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.661870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:48.735294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f072f-f28f-4465-b287-5089850a3e3b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:48.757250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 150/291] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:48.764197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:48.796133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.797045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.797323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.797651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a/users/b537b7ce35c44cc2b514cf1b3ff1039f/roles/70e769b176f444edb0bcb6006e3b5740` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.799731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=6da87e604181436c81ef188a81ee128a, user_id=b537b7ce35c44cc2b514cf1b3ff1039f, role_id=70e769b176f444edb0bcb6006e3b5740)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.801233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.845873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 142/292] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:29:48 2022] PUT /identity/v3/projects/6da87e604181436c81ef188a81ee128a/users/b537b7ce35c44cc2b514cf1b3ff1039f/roles/70e769b176f444edb0bcb6006e3b5740 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:48.893268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52a8c0-24e6-4480-bdd6-2b4635f2b8a1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:48.902594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:48.937756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0269e3-08aa-4e6b-a499-5fd4a7e14f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:48.938616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0269e3-08aa-4e6b-a499-5fd4a7e14f4c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:48.938894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0269e3-08aa-4e6b-a499-5fd4a7e14f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:48.939172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0269e3-08aa-4e6b-a499-5fd4a7e14f4c None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:48.940451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0269e3-08aa-4e6b-a499-5fd4a7e14f4c None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:48.941891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0269e3-08aa-4e6b-a499-5fd4a7e14f4c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:48.943959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 151/293] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:48 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:48.949616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:49.032496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:49.093180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2f87-555c-4bff-9dcb-a79d5df27a8c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:49.128579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:49.129236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.129521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.129798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.130636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=c746273147da4ad994f3589f1e93f39a) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:49.130946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:49.132407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9347816-4157-42a8-9f52-0506ddec754b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:49.143548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 143/294] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:48 2022] GET /identity/v3/role_assignments?user.id=c746273147da4ad994f3589f1e93f39a&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:49.278097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f34970-26ed-43d2-a274-6109c5cde564 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.279414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f34970-26ed-43d2-a274-6109c5cde564 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.279911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f34970-26ed-43d2-a274-6109c5cde564 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.281809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 152/295] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:49.287955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.288246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.288525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.308113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:49.309309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:49.380257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 144/296] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:49.404094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f34970-26ed-43d2-a274-6109c5cde564 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:49.520750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f34970-26ed-43d2-a274-6109c5cde564 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:49.576457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9ebf2-019b-4943-8882-24f086fd46ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:49.577252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9ebf2-019b-4943-8882-24f086fd46ec None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.577534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9ebf2-019b-4943-8882-24f086fd46ec None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.577807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9ebf2-019b-4943-8882-24f086fd46ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.593743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9ebf2-019b-4943-8882-24f086fd46ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-57a9ebf2-019b-4943-8882-24f086fd46ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:49.602076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:49.602934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:49.603743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 153/297] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:49.611071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:49.620134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05dc88-affe-4204-ae17-01544e7a08a8 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.620134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05dc88-affe-4204-ae17-01544e7a08a8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.620134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05dc88-affe-4204-ae17-01544e7a08a8 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.620789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 154/298] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:49.626249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.626763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.627356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.650420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:49.652042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:49.669925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:49.682948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:49.724438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107a95-2151-4c38-bcd7-e095a6f204e1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:49.731052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 155/299] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:49.754475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:49.759601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:49.760276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.760559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.760834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.761593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:49.761896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:49.763855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:49.777099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 145/300] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:49.778313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:49.880554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987fa2-b67e-4e07-b75d-179597cfc80f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:49.909916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc34a2-e4af-4409-b4d1-381992bc8b4a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:49.916527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f525-1ba7-4896-8bc1-3df9d7a6348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:49.917727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f525-1ba7-4896-8bc1-3df9d7a6348d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.918015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f525-1ba7-4896-8bc1-3df9d7a6348d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.918291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f525-1ba7-4896-8bc1-3df9d7a6348d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.919864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7f525-1ba7-4896-8bc1-3df9d7a6348d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:49.921623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7f525-1ba7-4896-8bc1-3df9d7a6348d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:49.923028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:49.927682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 156/301] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:49.927682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c175-a927-460b-a1e8-caae8a3119d9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.927682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c175-a927-460b-a1e8-caae8a3119d9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.927682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c175-a927-460b-a1e8-caae8a3119d9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.927682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 157/302] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:49.931377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c175-a927-460b-a1e8-caae8a3119d9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:49.949394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149ffd6-bb24-4773-974f-2dbc37e573e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:49.950265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ffd6-bb24-4773-974f-2dbc37e573e6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.951084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ffd6-bb24-4773-974f-2dbc37e573e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.951365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ffd6-bb24-4773-974f-2dbc37e573e6 None admin] PATH_INFO: `/v3/users/5faa84a4f4a440a990a51c6973ad5da8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.965161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149ffd6-bb24-4773-974f-2dbc37e573e6 None admin] RBAC: Authorizing `identity:get_user(user_id=5faa84a4f4a440a990a51c6973ad5da8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:49.965532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:49.967235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149ffd6-bb24-4773-974f-2dbc37e573e6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:49.973804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 146/303] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:49 2022] GET /identity/v3/users/5faa84a4f4a440a990a51c6973ad5da8 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:49.973804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:49.973804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:49.973804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:49.989055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:49.990233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:50.045064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c175-a927-460b-a1e8-caae8a3119d9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:50.058676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 147/304] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:50.068279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:50.082110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:50.082830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:50.083113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:50.083516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] PATH_INFO: `/v3/groups` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:50.084260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:50.085832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:50.102777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 158/305] 10.222.0.57 () {60 vars in 1134 bytes} [Mon Jul 25 08:29:49 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:29:50.103656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:50.191634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:50.196768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bed68f-e48d-4912-b679-b6ae45cdbec0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:50.240835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:50.241475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:50.242277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:50.242426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:50.242758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:50.244137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] RBAC: Adding query filter params (role.id=70e769b176f444edb0bcb6006e3b5740, user.id=5faa84a4f4a440a990a51c6973ad5da8, scope.system=all) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:50.244411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:50.246525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:50.254855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 148/306] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Jul 25 08:29:50 2022] GET /identity/v3/role_assignments?user.id=5faa84a4f4a440a990a51c6973ad5da8&scope.system=all&role.id=70e769b176f444edb0bcb6006e3b5740 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:50.262877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0979-7d31-4e7a-911b-eee3e7cc9e08 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:50.313971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:50.315200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:50.315713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:50.316192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:50.329408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:50.338004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:50.339028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:50.339858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:50.340439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 159/307] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:50.347217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:50.458212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0e973-bf27-4895-954f-9bd6546e1bd6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:50.495785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:50.496833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:50.498136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:50.498613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:50.499589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:50.500121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:50.501705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:50.511004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 149/308] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:50.516791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:50.637217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3c540-9405-41c9-92fa-798a4b407b88 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:50.673172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d996-ffdf-4a76-8814-dca909e3248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:50.674401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d996-ffdf-4a76-8814-dca909e3248b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:50.674888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d996-ffdf-4a76-8814-dca909e3248b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:50.675364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d996-ffdf-4a76-8814-dca909e3248b None admin] PATH_INFO: `/v3/users/d7a94448f3e9490daeb8b7c1e12044ee` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:50.676840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5d996-ffdf-4a76-8814-dca909e3248b None admin] RBAC: Authorizing `identity:get_user(user_id=d7a94448f3e9490daeb8b7c1e12044ee)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:50.678515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5d996-ffdf-4a76-8814-dca909e3248b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:50.680731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 160/309] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:50 2022] GET /identity/v3/users/d7a94448f3e9490daeb8b7c1e12044ee => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:50.691422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:50.717351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:50.796448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8472a-c82f-486d-9db1-452f8872237f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:50.832328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee508b2-e740-4a62-aaf5-9ff1900157c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:50.833211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee508b2-e740-4a62-aaf5-9ff1900157c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:50.833497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee508b2-e740-4a62-aaf5-9ff1900157c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:50.833777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee508b2-e740-4a62-aaf5-9ff1900157c6 None admin] PATH_INFO: `/v3/system/users/d7a94448f3e9490daeb8b7c1e12044ee/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:50.835337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee508b2-e740-4a62-aaf5-9ff1900157c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d7a94448f3e9490daeb8b7c1e12044ee, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:50.836799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee508b2-e740-4a62-aaf5-9ff1900157c6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:50.847873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 150/310] 10.222.0.57 () {58 vars in 1334 bytes} [Mon Jul 25 08:29:50 2022] PUT /identity/v3/system/users/d7a94448f3e9490daeb8b7c1e12044ee/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:29:51.127113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb225d-228a-44c8-850c-73a44cb33feb None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:51.127510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb225d-228a-44c8-850c-73a44cb33feb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:51.127709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb225d-228a-44c8-850c-73a44cb33feb None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:51.129342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 161/311] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:51.134579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:51.134867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:51.135142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:51.153404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:51.154602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:51.227498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 151/312] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:51.248023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb225d-228a-44c8-850c-73a44cb33feb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:51.269604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:51.367274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb225d-228a-44c8-850c-73a44cb33feb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:51.406222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:51.407247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:51.407706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:51.408126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:51.419770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:51.428206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:51.429375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:51.430381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:51.432886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 162/313] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:51.439562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:51.460794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:51.549181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec94f-49d6-4356-9a20-9f56e42583de None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:51.588639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:51.589641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:51.590130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:51.590633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:51.592143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:51.592674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:51.594251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:51.603190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 152/314] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:51.612530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:51.697107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:51.720805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd735-782f-45cc-abb8-e41284b82225 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:51.756843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:51.758051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:51.758535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:51.759051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] PATH_INFO: `/v3/users/b537b7ce35c44cc2b514cf1b3ff1039f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:51.760491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] RBAC: Authorizing `identity:get_user(user_id=b537b7ce35c44cc2b514cf1b3ff1039f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:51.762137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:51.764053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 163/315] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:51 2022] GET /identity/v3/users/b537b7ce35c44cc2b514cf1b3ff1039f => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:51.772485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:51.857637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:51.877544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da631-2507-4939-a7cd-0982a15d0b6f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:51.917356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b08d0-101f-40e5-9bad-0d35122a1758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:51.918371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b08d0-101f-40e5-9bad-0d35122a1758 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:51.918860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b08d0-101f-40e5-9bad-0d35122a1758 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:51.919422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b08d0-101f-40e5-9bad-0d35122a1758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:51.989360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b08d0-101f-40e5-9bad-0d35122a1758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:51.991155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b08d0-101f-40e5-9bad-0d35122a1758 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:52.076748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:52.096699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 153/316] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:52.104486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:52.208357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b667-5d31-4ca1-8722-ae4d1b4f7858 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.208668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b667-5d31-4ca1-8722-ae4d1b4f7858 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.208918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b667-5d31-4ca1-8722-ae4d1b4f7858 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.210553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 154/317] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:52.213869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522468f-ed28-4767-a024-e4b8b0712f3f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:52.215418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.215715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.215995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.234712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:52.235932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:52.255156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:52.256242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.256661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.257068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.258379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:52.260009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:52.262164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 164/318] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:52 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:52.268305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:52.287817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:52.323633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 155/319] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:52.338294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:52.394367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb9f05-e121-467d-82c9-1eeb08667f2d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:52.429792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:52.430835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.431313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.431832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.432852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] RBAC: Adding query filter params (role.id=70e769b176f444edb0bcb6006e3b5740, scope.project.id=6da87e604181436c81ef188a81ee128a, user.id=b537b7ce35c44cc2b514cf1b3ff1039f) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:52.433359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:52.435549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff720-60bc-4e27-8a2a-10f98b35b079 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:52.443886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 165/320] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:29:52 2022] GET /identity/v3/role_assignments?user.id=b537b7ce35c44cc2b514cf1b3ff1039f&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=70e769b176f444edb0bcb6006e3b5740 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:52.459645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e769c-0760-40d9-8515-f7cc7d890cb6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:52.471852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2294cef-ba9e-4d3a-b37b-b1e4c44773a4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.472479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2294cef-ba9e-4d3a-b37b-b1e4c44773a4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.472949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2294cef-ba9e-4d3a-b37b-b1e4c44773a4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.474899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 166/321] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:52.482786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.483432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.483912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.484487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:52.504470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:52.505924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:52.507503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:52.508535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.508974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.509399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.510817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:52.512528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:52.515453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 156/322] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:29:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:52.522344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:52.599425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 167/323] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:52.615527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:52.628171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:52.659447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a33282-4d1d-47f5-a907-eb1794d3eaa1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:52.701774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:52.702789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.703302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.703815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] PATH_INFO: `/v3/groups` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.704740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:52.706399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:52.729091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 157/324] 10.222.0.57 () {60 vars in 1134 bytes} [Mon Jul 25 08:29:52 2022] POST /identity/v3/groups => generated 226 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:29:52.748316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11661ac-ff74-407a-9c00-6196cf55d344 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:52.788843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60a27-559a-4b8c-9570-4e9f65da2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:52.789608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60a27-559a-4b8c-9570-4e9f65da2b34 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.789935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60a27-559a-4b8c-9570-4e9f65da2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.790209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60a27-559a-4b8c-9570-4e9f65da2b34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.802883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60a27-559a-4b8c-9570-4e9f65da2b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a9d60a27-559a-4b8c-9570-4e9f65da2b34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:52.811457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:52.812404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:52.818660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 168/325] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:52.819327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:52.868010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:52.936022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ba424-e93d-406e-99ec-26c216638ce4 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:52.964885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479df41-8cf2-4c38-ac50-0717e72b6d44 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.965181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479df41-8cf2-4c38-ac50-0717e72b6d44 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.965481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479df41-8cf2-4c38-ac50-0717e72b6d44 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.969368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 169/326] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:52.973704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.973994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.974280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.974642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:52.975681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:52.976278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:52.976854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:52.977824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:52.978305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:52.979906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:52.996478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 158/327] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:53.002925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:53.003312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:53.004584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:53.090538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:53.103176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 170/328] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:53.126634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:53.149140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de55be-12e8-481a-94c9-7cff18413640 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:53.151126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:53.202794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:53.204389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:53.205343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:53.206046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] PATH_INFO: `/v3/users/5faa84a4f4a440a990a51c6973ad5da8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:53.207513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] RBAC: Authorizing `identity:get_user(user_id=5faa84a4f4a440a990a51c6973ad5da8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:53.209418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:53.212274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 159/329] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:53 2022] GET /identity/v3/users/5faa84a4f4a440a990a51c6973ad5da8 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:53.217956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:53.251312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d6d65-3333-4784-b1e1-2d24365788cf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:53.289293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:53.290258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:53.290688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:53.290983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:53.303575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:53.313714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:53.315179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:53.316512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:53.319641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 171/330] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:29:53.321549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:53.368256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4aea9-a147-4599-97ab-6f353a1c3a99 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:53.405016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:53.421972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:53.423109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:53.423645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:53.424108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] PATH_INFO: `/v3/system/users/5faa84a4f4a440a990a51c6973ad5da8/roles/70e769b176f444edb0bcb6006e3b5740` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:53.425830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5faa84a4f4a440a990a51c6973ad5da8, role_id=70e769b176f444edb0bcb6006e3b5740)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:53.429707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:53.441281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 160/331] 10.222.0.57 () {58 vars in 1334 bytes} [Mon Jul 25 08:29:53 2022] PUT /identity/v3/system/users/5faa84a4f4a440a990a51c6973ad5da8/roles/70e769b176f444edb0bcb6006e3b5740 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:29:53.468465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470064-8475-4d34-8d59-2bbf766fe7f4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:53.507640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:53.508331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:53.508611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:53.508886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:53.509655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:53.509957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:53.511457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:53.524622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 172/332] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:53.528472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:53.571477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:53.646797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f5610-d620-4ea4-871f-4e7917104a24 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:53.682661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c487fdb-c810-444a-a42c-d570d1c14221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:53.683582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c487fdb-c810-444a-a42c-d570d1c14221 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:53.683923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c487fdb-c810-444a-a42c-d570d1c14221 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:53.684198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c487fdb-c810-444a-a42c-d570d1c14221 None admin] PATH_INFO: `/v3/users/d7a94448f3e9490daeb8b7c1e12044ee` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:53.685475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c487fdb-c810-444a-a42c-d570d1c14221 None admin] RBAC: Authorizing `identity:get_user(user_id=d7a94448f3e9490daeb8b7c1e12044ee)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:53.686978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c487fdb-c810-444a-a42c-d570d1c14221 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:53.689931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 161/333] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:53 2022] GET /identity/v3/users/d7a94448f3e9490daeb8b7c1e12044ee => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:53.694865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:53.811565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ebbb-48b5-4ef9-90ed-19f3f32fe8cd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:53.837386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:53.855990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:53.856743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:53.857029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:53.857305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:53.858142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] RBAC: Adding query filter params (role.id=6a4dda1bb50c4b16ae906ea0a9870854, user.id=d7a94448f3e9490daeb8b7c1e12044ee, scope.system=all) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:53.858452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:53.859917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5711e-f820-49b5-b409-f3e140f495d8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:53.878704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 173/334] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Jul 25 08:29:53 2022] GET /identity/v3/role_assignments?user.id=d7a94448f3e9490daeb8b7c1e12044ee&scope.system=all&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:55.065317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317e29-af46-41cb-aa75-a09754bdc3eb None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.065821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317e29-af46-41cb-aa75-a09754bdc3eb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.065924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317e29-af46-41cb-aa75-a09754bdc3eb None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.067409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 162/335] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:55.073875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.073875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.073875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.095721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:55.097276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:55.170101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 174/336] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:55.194537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317e29-af46-41cb-aa75-a09754bdc3eb None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:55.318602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317e29-af46-41cb-aa75-a09754bdc3eb None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:55.327708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:55.360740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75960b19-ce53-4ccb-bc6b-f68cd4cfcc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:55.361553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960b19-ce53-4ccb-bc6b-f68cd4cfcc59 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.361833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960b19-ce53-4ccb-bc6b-f68cd4cfcc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.362107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960b19-ce53-4ccb-bc6b-f68cd4cfcc59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.373154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75960b19-ce53-4ccb-bc6b-f68cd4cfcc59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-75960b19-ce53-4ccb-bc6b-f68cd4cfcc59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:55.381055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:55.381906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:55.382666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 163/337] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:55.389598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:55.421060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3fbb-00e7-4cdc-8418-ebd01af9d53c None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.421402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3fbb-00e7-4cdc-8418-ebd01af9d53c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.421623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3fbb-00e7-4cdc-8418-ebd01af9d53c None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.423280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 164/338] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:55.431409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.431409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.431409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.451412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:55.451412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:55.540853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba533dc-00ca-4beb-93f5-af1be6a152f9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:55.544914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 165/339] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:29:55.557659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:55.582507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:55.601005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:55.601710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.602035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.602311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.603067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:55.603370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:55.604773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:55.618671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 175/340] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:55.624324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:55.761224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298538-bfe4-4bfd-ad4a-419ff318c647 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:55.802291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:55.802956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.803237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.803540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.803740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:55.818264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bcf8-4f7e-4a10-aab1-6298bc0e3b75 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:55.883858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:55.903701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:55.905055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:55.905339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:55.905615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:55.934468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:55.953284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:55.954211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:55.954986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:55.965373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:55.966920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:55.969079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 166/341] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:55.970251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.096486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 176/342] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:29:56.102761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.187909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:56.201739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38dcbc-a863-4467-bb6b-f234e2e79b6b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:56.222043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16b220-0c28-4405-adc8-c00460929188 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:56.262450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c053b81-3980-4c7f-8325-8aadb3da74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:56.263909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053b81-3980-4c7f-8325-8aadb3da74d4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.264298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053b81-3980-4c7f-8325-8aadb3da74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.264648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053b81-3980-4c7f-8325-8aadb3da74d4 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.265845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c053b81-3980-4c7f-8325-8aadb3da74d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:56.267286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c053b81-3980-4c7f-8325-8aadb3da74d4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:56.268104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:56.268783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.269066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.269343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.269450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 177/343] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:56.270194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:56.270504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:56.275444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:56.282756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503febe-647f-47b9-9867-f7343121bec2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.283315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503febe-647f-47b9-9867-f7343121bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.283881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503febe-647f-47b9-9867-f7343121bec2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.285108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 167/344] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:56.286136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 178/345] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:29:56.288711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.292321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503febe-647f-47b9-9867-f7343121bec2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.308557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:56.405103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fe6b8-dfc6-4dc8-a372-f4664fe79986 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:56.418754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503febe-647f-47b9-9867-f7343121bec2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:56.442550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417729c-05a0-45be-9c75-10d819fbce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:56.443340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417729c-05a0-45be-9c75-10d819fbce48 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.443646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417729c-05a0-45be-9c75-10d819fbce48 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.443919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417729c-05a0-45be-9c75-10d819fbce48 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.450290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417729c-05a0-45be-9c75-10d819fbce48 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:56.451818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417729c-05a0-45be-9c75-10d819fbce48 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:56.453770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 168/346] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:56.454938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.455223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.459578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.461987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:56.463104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.463655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.464125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.474088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:56.480556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:56.482302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:56.541098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:56.542914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:56.556884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 169/347] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:56.556884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.570467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:56.655257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 179/348] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:29:56.660506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.671753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c6483-acdb-44ca-93f0-76b468fae35c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:56.706879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:56.707492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.707780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.708058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.708897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=f35f46b95f85486399f17f9fe12bcf75) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:56.709206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:56.710645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:56.718822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 170/349] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:56.723778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.728306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:56.780364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37f71-9d63-4156-99ff-b9857874e540 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:56.854179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572309-fc89-4ed1-beed-5eca8d9c5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:56.855005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572309-fc89-4ed1-beed-5eca8d9c5b71 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.855282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572309-fc89-4ed1-beed-5eca8d9c5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.855599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572309-fc89-4ed1-beed-5eca8d9c5b71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.871743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98572309-fc89-4ed1-beed-5eca8d9c5b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-98572309-fc89-4ed1-beed-5eca8d9c5b71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:56.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:56.880574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:56.881809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 180/350] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:56.882642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7b01e-3f71-4c1d-9da2-65b4dcdc2287 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:56.882908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7b01e-3f71-4c1d-9da2-65b4dcdc2287 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:56.884767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7b01e-3f71-4c1d-9da2-65b4dcdc2287 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:56.884767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 181/351] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:56.886567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7b01e-3f71-4c1d-9da2-65b4dcdc2287 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:56.947049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.030210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca10fe-ac41-4ee9-9ae1-44cda3792a05 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.038870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7b01e-3f71-4c1d-9da2-65b4dcdc2287 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.055732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.094087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.095016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.095302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.095609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.096372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:57.096679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.098071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.105658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890808-e9db-451c-914d-680903354052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.107359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890808-e9db-451c-914d-680903354052 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.107691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890808-e9db-451c-914d-680903354052 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.107969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890808-e9db-451c-914d-680903354052 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.109305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c890808-e9db-451c-914d-680903354052 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.110830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c890808-e9db-451c-914d-680903354052 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.112795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 171/352] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:57.113308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 182/353] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:57.118768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.118936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.119210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.119557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.151048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:57.154837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:57.301895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 172/354] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:57.303482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f2c6e-f6f8-4094-8c38-f4e59b6f7288 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.303887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.368257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf7cd9-72a7-4113-85f7-58600d88859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.369515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7cd9-72a7-4113-85f7-58600d88859c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.370001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7cd9-72a7-4113-85f7-58600d88859c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.370475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7cd9-72a7-4113-85f7-58600d88859c None admin] PATH_INFO: `/v3/users/5faa84a4f4a440a990a51c6973ad5da8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.372910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf7cd9-72a7-4113-85f7-58600d88859c None admin] RBAC: Authorizing `identity:get_user(user_id=5faa84a4f4a440a990a51c6973ad5da8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.374584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf7cd9-72a7-4113-85f7-58600d88859c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.381352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 183/355] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/users/5faa84a4f4a440a990a51c6973ad5da8 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:29:57.383025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d85a5-7770-4a4b-8e61-6efe4b8181d2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.383555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d85a5-7770-4a4b-8e61-6efe4b8181d2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.384038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d85a5-7770-4a4b-8e61-6efe4b8181d2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.386571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 184/356] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:57.387547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d85a5-7770-4a4b-8e61-6efe4b8181d2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.423778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.426678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.466188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344962f-7544-41f7-8f06-7d6dbc91e8f0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.507966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d85a5-7770-4a4b-8e61-6efe4b8181d2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.522641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.524940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.525229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.525501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.526761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.530664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.532945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 173/357] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:57.537906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.560873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c345824-d8b2-4364-a30f-8988233be3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.561787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345824-d8b2-4364-a30f-8988233be3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.562067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345824-d8b2-4364-a30f-8988233be3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.562336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345824-d8b2-4364-a30f-8988233be3b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.573499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c345824-d8b2-4364-a30f-8988233be3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1c345824-d8b2-4364-a30f-8988233be3b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:57.582666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:57.583589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:29:57.584345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 185/358] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:57.585462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.585462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.591410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.611180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:57.612495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:57.658670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b026ac-73de-4351-87be-20a63ed5d903 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.690665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 186/359] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:57.694994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.695612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.695743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.696011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.696290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.697130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] RBAC: Adding query filter params (role.id=70e769b176f444edb0bcb6006e3b5740, user.id=5faa84a4f4a440a990a51c6973ad5da8, scope.system=all) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:57.697440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.698868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.704714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.713443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 174/360] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/role_assignments?user.id=5faa84a4f4a440a990a51c6973ad5da8&scope.system=all&role.id=70e769b176f444edb0bcb6006e3b5740 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:57.714430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.731849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.829200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897a45-d9c9-4d63-b994-bf4bad2e4476 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.858803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04828-14c2-4505-8d69-1ac1a1be0cf9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:57.866880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.867595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.867882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.868158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.868919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:57.869224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.870614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.881274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 175/361] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:57.882177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:57.934799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:57.936097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:57.936377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:57.936647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:57.937607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=f35f46b95f85486399f17f9fe12bcf75) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:57.938024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:57.939524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:57.948072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:57.955569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 187/362] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:57.955569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.028946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164117-00b2-4d59-b92b-dad53d7d4d67 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.077507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b51b00-b911-4b59-93a2-f94d349d61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.078487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b51b00-b911-4b59-93a2-f94d349d61b1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.078736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b51b00-b911-4b59-93a2-f94d349d61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.079012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b51b00-b911-4b59-93a2-f94d349d61b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.087651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.097679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b51b00-b911-4b59-93a2-f94d349d61b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-73b51b00-b911-4b59-93a2-f94d349d61b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:58.106658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:58.108179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:58.108966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 176/363] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:58.110165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478c7d-d0cc-450e-905b-b1ac43463ca2 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.110785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478c7d-d0cc-450e-905b-b1ac43463ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.110785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478c7d-d0cc-450e-905b-b1ac43463ca2 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.114009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60ed4-aeee-4476-8996-f652bfc52a98 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.116856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 177/364] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:58.118612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c478c7d-d0cc-450e-905b-b1ac43463ca2 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.162070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.162665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.162953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.163227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.262141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c478c7d-d0cc-450e-905b-b1ac43463ca2 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.265461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:58.267165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:58.282790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.298389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.299059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.299340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.299639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.300393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:58.300698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:58.302274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76bc6-48fa-4dcf-8709-e993f6d68da6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:58.313335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 178/365] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:58.314757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.315049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.315315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.334411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:58.335620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:58.371858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.400333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 188/366] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:58.401287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.425794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 179/367] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:58.426930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.539607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1050bcf-fba3-42ff-b587-c23ee66d4666 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.579898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.580549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.580832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.581107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.589139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885773-37ac-4867-ab7f-05b99e0a6dfb None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.604256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.636208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.637037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.637330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.637609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.640257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:58.641732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:58.643672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 180/368] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:58.645681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.656668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.682365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:58.683884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:58.792418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e06c-0577-4122-884d-44db126e311b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.809167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 189/369] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:58.810168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.832339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.833139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.833423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.833700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.846136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:58.854637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:58.855549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:58.856305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 181/370] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:58.857453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:58.911282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.924774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:58.946663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91a1f-df8b-4e38-aaf9-50e5c53c49cc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.986427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:58.987435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:58.987784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:58.988122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:58.989373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:58.990832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:58.992729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f3e7-1859-4905-a4c5-934ac286f574 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:58.994250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 190/371] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:58.995092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.044728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.045607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.046314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.046602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.048162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:59.050414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:59.053401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 182/372] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:59.054256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.115311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb3dca-1c31-4a7f-8cc9-4da076fcc8d1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.157857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.158593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.158878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.159152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.160005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:59.160315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:59.161743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:59.170391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 191/373] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:59.171203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.197453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:59.198837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad57d44-5624-47c7-bdc2-5ea7edbabace None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.208553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:59.246706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.247956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.248264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.248546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.249662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=6da87e604181436c81ef188a81ee128a) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:59.249766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:59.251145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196816-b0b1-4a22-8588-efc58c6e4c8c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:59.258664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 183/374] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:59.264450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74516-e9fa-4994-8125-096dd1c1b8a3 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.264749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74516-e9fa-4994-8125-096dd1c1b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.265021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74516-e9fa-4994-8125-096dd1c1b8a3 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.266679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 184/375] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:29:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:29:59.271438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74516-e9fa-4994-8125-096dd1c1b8a3 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.327068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066e65-dde8-41bd-841c-45fa99672c63 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.374689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f4be-57a2-4675-9faa-a235d1c90e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.376006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f4be-57a2-4675-9faa-a235d1c90e9a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.376486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f4be-57a2-4675-9faa-a235d1c90e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.377207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f4be-57a2-4675-9faa-a235d1c90e9a None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.378694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586f4be-57a2-4675-9faa-a235d1c90e9a None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:59.380569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586f4be-57a2-4675-9faa-a235d1c90e9a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:59.382820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 192/376] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:59.388835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.389499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.389972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.405767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74516-e9fa-4994-8125-096dd1c1b8a3 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.413141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:29:59.414825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:29:59.444928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.445396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.445693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.445973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.491537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:59.495710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 193/377] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:29:59.496840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.518503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:59.539523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:59.542031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:59.643438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9921a-2cd5-4dc3-a31e-bc978e596181 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.683448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 185/378] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:29:59.683448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.689598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.690578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.691168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.691565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.692475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=6da87e604181436c81ef188a81ee128a) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:29:59.692854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:29:59.694509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:29:59.702194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 194/379] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:29:59.702909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.783795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:59.836512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5f28c-dbda-428f-9597-be7b4c0d5ace None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.887525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:29:59.897446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.898617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.899125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.899622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:29:59.926493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:29:59.934932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:29:59.935855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:29:59.936618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:29:59.940832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 186/380] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:29:59.948141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:29:59.948530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82428-f11f-4969-b286-4ff6a7f2aba1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:29:59.996163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:29:59.997035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:29:59.997312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:29:59.997615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] PATH_INFO: `/v3/projects/bf189989f41048d2bcf89c6d65f2316e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.000556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=bf189989f41048d2bcf89c6d65f2316e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.005048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.005048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 195/381] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/projects/bf189989f41048d2bcf89c6d65f2316e => generated 344 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:00.018325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:00.118518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e5ccb-136a-4acb-9e40-8f74312e44b0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:00.156097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:00.156278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139a63-9b62-49a6-aecb-4e64f7c3f2c9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:00.163747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:00.165980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.165980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.165980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.166363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:00.166827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.168396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.178956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 187/382] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:00.188684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:00.210240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:00.211419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.212019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.212368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] PATH_INFO: `/v3/groups/5c58a191ccc84eeb953d16f3d8ff5694` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.222185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] RBAC: Authorizing `identity:get_group(group_id=5c58a191ccc84eeb953d16f3d8ff5694)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.226544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.228466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 196/383] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:00 2022] GET /identity/v3/groups/5c58a191ccc84eeb953d16f3d8ff5694 => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:00.237599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:00.258347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:00.329829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca7ab1-b092-4949-bd78-7b38b20f91d3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:00.377843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b029c-e792-4634-8df2-956720d36cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:00.379035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b029c-e792-4634-8df2-956720d36cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.379549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b029c-e792-4634-8df2-956720d36cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.380045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b029c-e792-4634-8df2-956720d36cf5 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.381456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b029c-e792-4634-8df2-956720d36cf5 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.383111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b029c-e792-4634-8df2-956720d36cf5 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.385340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 188/384] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:00 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:00.386782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976234a-7fc3-4aac-b83d-6b42709e07e7 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.387290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976234a-7fc3-4aac-b83d-6b42709e07e7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.387788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976234a-7fc3-4aac-b83d-6b42709e07e7 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.389777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 189/385] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:00.391847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976234a-7fc3-4aac-b83d-6b42709e07e7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:00.425122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9a0f1-270e-4b9d-9192-b02696f7ab08 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:00.474364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:00.474947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.475235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.475591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.476547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] RBAC: Adding query filter params (group.id=5c58a191ccc84eeb953d16f3d8ff5694, role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=bf189989f41048d2bcf89c6d65f2316e) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:00.476872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.481030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca355516-69e5-4170-be01-b63b26ff7447 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.487543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:00.491733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 197/386] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:30:00 2022] GET /identity/v3/role_assignments?group.id=5c58a191ccc84eeb953d16f3d8ff5694&scope.project.id=bf189989f41048d2bcf89c6d65f2316e&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:00.493127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.493418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.493697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.540514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976234a-7fc3-4aac-b83d-6b42709e07e7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:00.548568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:00.549782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:00.652575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:00.653477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.659411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.659411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.659411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.659411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.661601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 190/387] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:00 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:00.668544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:00.744662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:00.755616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 198/388] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:00.789542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:00.839678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892b12e-e4f8-4273-ab3d-c45a57a4711e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:00.881953 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:00.883025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:00.883314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:00.883619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:00.885757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] RBAC: Authorizing `identity:create_grant(project_id=f35f46b95f85486399f17f9fe12bcf75, group_id=c3b1570bc47b4ea585ae2f1c1c9a411a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:00.887219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:00.895821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:00.915917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 191/389] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Jul 25 08:30:00 2022] PUT /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:00.994981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a213b-f658-4723-b72c-a0fddd9f3d36 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:01.036114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:01.036953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:01.037238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:01.037515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:01.056398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:01.064889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:01.065819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:01.066576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 199/390] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:01.072198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:01.205189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cbaef-3cf4-42a6-a5cc-ec26a56dfd30 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:01.246099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:01.246697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:01.246982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:01.247260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:01.248649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:01.248960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:01.250391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:01.260684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 192/391] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:01.266664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:01.341078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:01.396506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b16a0-ad4e-4885-b9a6-2196b2d4dd91 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:01.439344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:01.440402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:01.440699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:01.440976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:01.442168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:01.443639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:01.445563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 200/392] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:01 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:01.451516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:01.508478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:01.585136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a349da-88dd-4493-916e-30c4cfb4b65d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:01.626249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc97751-e90e-46cd-9b6a-d51a6b87f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:01.627125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97751-e90e-46cd-9b6a-d51a6b87f27f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:01.627501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97751-e90e-46cd-9b6a-d51a6b87f27f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:01.627705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97751-e90e-46cd-9b6a-d51a6b87f27f None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:01.628908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc97751-e90e-46cd-9b6a-d51a6b87f27f None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:01.630352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc97751-e90e-46cd-9b6a-d51a6b87f27f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:01.633581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 193/393] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:01 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:01.640651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:01.762648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0daf88-fb1c-4a4b-97d9-e33f8774eee9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:01.799750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:01.806757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cdb7b-9b6d-40d5-99f9-9c3bcc1e446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:01.808024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cdb7b-9b6d-40d5-99f9-9c3bcc1e446c None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:01.808735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cdb7b-9b6d-40d5-99f9-9c3bcc1e446c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:01.809017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cdb7b-9b6d-40d5-99f9-9c3bcc1e446c None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:01.811333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cdb7b-9b6d-40d5-99f9-9c3bcc1e446c None admin] RBAC: Authorizing `identity:create_grant(project_id=f35f46b95f85486399f17f9fe12bcf75, group_id=c3b1570bc47b4ea585ae2f1c1c9a411a, role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:01.812799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cdb7b-9b6d-40d5-99f9-9c3bcc1e446c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:01.836408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 201/394] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Jul 25 08:30:01 2022] PUT /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:30:02.120877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b500-9096-4258-986f-00a698c5e1a6 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.121247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b500-9096-4258-986f-00a698c5e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.121426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b500-9096-4258-986f-00a698c5e1a6 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.123567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 194/395] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:02.130677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.130993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.131240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.151230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:02.152543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:02.230710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 202/396] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:02.252555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635b500-9096-4258-986f-00a698c5e1a6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:02.362098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635b500-9096-4258-986f-00a698c5e1a6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:02.379985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:02.397066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:02.397863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.398145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.398418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.409049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:02.417113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:02.418042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:02.418852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 195/397] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:02.424980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:02.537281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527251b4-670d-466b-a0a6-d1477b786ade None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:02.567758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:02.578735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:02.584234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.584614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.584855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.585652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:02.585963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:02.587463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589e1e4-eed0-4511-af0e-e2ef49e67cdf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:02.597307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 203/398] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:30:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:02.602839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:02.639703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e14cd-7e65-4e44-88c1-12d0a77a566f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.640005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e14cd-7e65-4e44-88c1-12d0a77a566f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.640196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e14cd-7e65-4e44-88c1-12d0a77a566f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.641984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 204/399] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:02.651771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.652359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.652847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.686562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:02.688153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:02.725117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75ca8-74dc-42ca-a9a7-c820a56e9702 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:02.776032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:02.777418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.777916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.778409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:02.780163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:02.781841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:02.783977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 196/400] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:02 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:02.792917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:02.794978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 205/401] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:02.822512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:02.868200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:02.941490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f9cb-9576-492a-939b-151af9a17b08 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:02.959829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:02.985105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:02.986404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:02.986777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:02.987110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.000149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:03.014630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:03.015723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:03.016498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:03.020532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5358f5-d569-45ed-aef3-c17f0ceab2d7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.022854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 206/402] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:03.045306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.094423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.096218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.097570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.099107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.103681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:03.106272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:03.110356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 197/403] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:02 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:03.123460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.259709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee356f5-3abd-4b7e-a393-91ed81bf146d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.301830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.303477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.305460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c199847-17d1-42a9-9556-9cdd85680ad9 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.305894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.306328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.307232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:03.309245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:03.311414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:03.327271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 207/404] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:03.345773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:03.345942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.365222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bbac1-ce17-4e91-9992-d079f68b67d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.366774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bbac1-ce17-4e91-9992-d079f68b67d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.367215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bbac1-ce17-4e91-9992-d079f68b67d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.367692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bbac1-ce17-4e91-9992-d079f68b67d6 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.376402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bbac1-ce17-4e91-9992-d079f68b67d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6da87e604181436c81ef188a81ee128a, group_id=c3b1570bc47b4ea585ae2f1c1c9a411a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:03.378454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bbac1-ce17-4e91-9992-d079f68b67d6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:03.407117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:03.409215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 198/405] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Jul 25 08:30:03 2022] PUT /identity/v3/projects/6da87e604181436c81ef188a81ee128a/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:30:03.410939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563d4b-0d47-4e54-b51a-c830caeaa01d None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.419836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563d4b-0d47-4e54-b51a-c830caeaa01d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.419836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563d4b-0d47-4e54-b51a-c830caeaa01d None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.419836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 199/406] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:03.421038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.422308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.422308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.447562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:03.447562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:03.527157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 200/407] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:30:03.535500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ddce-6cb2-47f8-b817-617fa65c9ead None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.549926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.594698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee486e7-5324-4a4e-8fb2-11b7f4c9d5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.596135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee486e7-5324-4a4e-8fb2-11b7f4c9d5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.596561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee486e7-5324-4a4e-8fb2-11b7f4c9d5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.596990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee486e7-5324-4a4e-8fb2-11b7f4c9d5e1 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.598401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee486e7-5324-4a4e-8fb2-11b7f4c9d5e1 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:03.600084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee486e7-5324-4a4e-8fb2-11b7f4c9d5e1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:03.602280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 208/408] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:03 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:03.603950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1944a1-29d1-4b98-ab59-c727821e8440 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.604384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1944a1-29d1-4b98-ab59-c727821e8440 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.604816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1944a1-29d1-4b98-ab59-c727821e8440 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.611795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 209/409] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:03.612955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1944a1-29d1-4b98-ab59-c727821e8440 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.672171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80208a25-8d26-430f-979d-3d0b7aa0a17d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.702183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:03.718797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53577-a4d7-4363-b555-b563119b4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.720513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53577-a4d7-4363-b555-b563119b4360 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.721017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53577-a4d7-4363-b555-b563119b4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.721559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53577-a4d7-4363-b555-b563119b4360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.738921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53577-a4d7-4363-b555-b563119b4360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-13b53577-a4d7-4363-b555-b563119b4360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:03.749657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:03.750824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:03.751605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 201/410] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:03.752998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.753364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.753715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.764107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:03.768503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1944a1-29d1-4b98-ab59-c727821e8440 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.775903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:03.777347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:03.812752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.813927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.814466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.814910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.816555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:03.819076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:03.821277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 210/411] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:03 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:03.827349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.866611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 202/412] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:03.868559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:03.956847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd76b93-f592-459c-952e-55837240d5cc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:03.993732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:03.994402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:03.994686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:03.994966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:03.995776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:03.996093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:03.996615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:03.998555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:04.008722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbdd0c-dfc7-423b-b912-e5fbcf9c85b1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.010737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 211/413] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:04.011629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.047669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:04.056626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.057777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.058284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.058757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.062791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] RBAC: Authorizing `identity:create_grant(project_id=6da87e604181436c81ef188a81ee128a, group_id=c3b1570bc47b4ea585ae2f1c1c9a411a, role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:04.065150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:04.091425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 203/414] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Jul 25 08:30:03 2022] PUT /identity/v3/projects/6da87e604181436c81ef188a81ee128a/groups/c3b1570bc47b4ea585ae2f1c1c9a411a/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:04.091425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.205443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78313728-27b4-4816-8b97-9edb4f3132b7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.250810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c3cf4-3571-40a0-9d73-0ad3c507d96f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.293567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.295442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.295924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.296909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] PATH_INFO: `/v3/groups/5c58a191ccc84eeb953d16f3d8ff5694` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.298583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] RBAC: Authorizing `identity:get_group(group_id=5c58a191ccc84eeb953d16f3d8ff5694)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:04.300291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:04.303551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 204/415] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:04 2022] GET /identity/v3/groups/5c58a191ccc84eeb953d16f3d8ff5694 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:04.309483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.311297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.312173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.312451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.312726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.331961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:04.340844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:04.342312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:30:04.343079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:04.344139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 212/416] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:04.349867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.351380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:04.454433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403acc91-b76a-42c0-8d44-5ca540cf1b11 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.462282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:04.487179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257e36-860b-4b22-a6af-86ab2ee803ae None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.503900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.505091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.505575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.506056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] PATH_INFO: `/v3/projects/bf189989f41048d2bcf89c6d65f2316e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.507564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] RBAC: Authorizing `identity:get_project(project_id=bf189989f41048d2bcf89c6d65f2316e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:04.509600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:04.515808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 205/417] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:04 2022] GET /identity/v3/projects/bf189989f41048d2bcf89c6d65f2316e => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:04.520447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.566168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.566845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.567127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.567419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.568188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:04.568494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:04.569869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:04.589225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 213/418] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:30:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:04.595742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.663834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:04.675957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3b07-cdc4-4fe9-a780-4f899f79e46e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.720942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa41f5-3567-4934-aeb2-3a712403aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.722511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa41f5-3567-4934-aeb2-3a712403aac8 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.722804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa41f5-3567-4934-aeb2-3a712403aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.723081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa41f5-3567-4934-aeb2-3a712403aac8 None admin] PATH_INFO: `/v3/projects/bf189989f41048d2bcf89c6d65f2316e/groups/5c58a191ccc84eeb953d16f3d8ff5694/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.725513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa41f5-3567-4934-aeb2-3a712403aac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf189989f41048d2bcf89c6d65f2316e, group_id=5c58a191ccc84eeb953d16f3d8ff5694, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:04.727771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa41f5-3567-4934-aeb2-3a712403aac8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:04.738315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceb324-51d3-41e4-be90-5c72ee6e39c7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:04.749158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 206/419] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Jul 25 08:30:04 2022] PUT /identity/v3/projects/bf189989f41048d2bcf89c6d65f2316e/groups/5c58a191ccc84eeb953d16f3d8ff5694/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:04.751169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7e9e-f8fa-4194-bfe9-4d660d5657f9 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.751658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7e9e-f8fa-4194-bfe9-4d660d5657f9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.752440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7e9e-f8fa-4194-bfe9-4d660d5657f9 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.758516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 207/420] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:04.761695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.762188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.762832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.786913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:04.787660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:04.788302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:04.788659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:04.789095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:04.789556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:04.827378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:04.867152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 208/421] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:04.893735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:04.908491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:04.909999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.021360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:05.048527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943e481-e563-433e-aabe-dfa1c80f6c22 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.054669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 214/422] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:30:05.061100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.087818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.088834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.089121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.089400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.101446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:05.110556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:05.111540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:05.112317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 209/423] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:05.119589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.174399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:05.229372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accde2d-f0e9-4b42-9845-c72e486c8d2f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.273968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.274901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.275185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.275587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.283329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:05.283329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.283329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 215/424] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:05.283596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e82b-09e3-42e9-a398-ae9db8470f4e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.288834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.321869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.322539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.322819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.323104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.323889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:05.324195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:05.326263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.335041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 210/425] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:05.340493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.343360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:05.449195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963199b1-2bc7-4d96-b35e-64233c7f2de0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.489490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.490140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.490421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.490696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.520060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6581f8d-d057-451e-a0b8-5b538a877a78 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.572657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:05.600339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.601120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.601399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.601672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.606102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:05.608140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.609782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 216/426] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:05.616215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.642773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:05.644274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.646150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:05.751115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 211/427] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:05.756623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.797483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eeb72-0d27-4288-9bd7-9f929ee84850 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.878182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7ef1-c0f4-4b05-99b6-58a4f6b87949 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:05.887543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:05.927198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.930956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.930956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.930956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] PATH_INFO: `/v3/projects/f35f46b95f85486399f17f9fe12bcf75` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.930956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] RBAC: Authorizing `identity:get_project(project_id=f35f46b95f85486399f17f9fe12bcf75)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:05.935410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.935543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:05.935543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.935543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.943409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.943409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=f35f46b95f85486399f17f9fe12bcf75) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:05.943409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:05.943777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea1e15-c82d-4e6d-aa5b-6c69099b693e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:05.947415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 212/428] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/projects/f35f46b95f85486399f17f9fe12bcf75 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:05.947415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:05.963419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 217/429] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 611 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:05.973382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534edb8-c087-4815-846a-f3c923a0d83d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.973587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534edb8-c087-4815-846a-f3c923a0d83d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.973801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534edb8-c087-4815-846a-f3c923a0d83d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:05.979790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 218/430] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:05.982941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:05.983231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:05.983767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.028434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:06.030223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:06.134738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25bb3-8edd-4f6b-89e9-facb0ae15d4c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:06.139831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:06.187498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 219/431] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:06.202725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:06.203628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.203916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.204197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.207009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:06.208713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:06.210380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 213/432] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:05 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:06.217135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:06.217345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:06.276811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:06.397692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce484e57-eb96-4bce-9869-8937da603202 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:06.428641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabeca6-3f4b-447d-8c80-c273d9119273 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:06.443933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:06.445446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.445736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.446011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.446851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=f35f46b95f85486399f17f9fe12bcf75) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:06.447162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:06.451408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:06.456903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 214/433] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:30:06 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=f35f46b95f85486399f17f9fe12bcf75&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:06.485598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbca9fc-5978-4c69-8c43-ed0f8c3a4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:06.486450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbca9fc-5978-4c69-8c43-ed0f8c3a4f17 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.486733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbca9fc-5978-4c69-8c43-ed0f8c3a4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.487073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbca9fc-5978-4c69-8c43-ed0f8c3a4f17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.500247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbca9fc-5978-4c69-8c43-ed0f8c3a4f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ccbca9fc-5978-4c69-8c43-ed0f8c3a4f17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:06.508397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:06.509319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:30:06.510083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:06.510671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 220/434] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:06.516310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:06.593083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c218-640e-454e-8dde-68a9992b6d93 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.593582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c218-640e-454e-8dde-68a9992b6d93 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.593655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c218-640e-454e-8dde-68a9992b6d93 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.595420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 221/435] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:06.600908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.601171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.601449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.634524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:06.637691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:06.696411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb170d-9ef7-4074-b8df-59e4ba364029 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:06.699359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:06.701629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:06.743097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:06.749449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.749449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.749449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.749449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:06.749449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:06.749855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 222/436] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:06.749990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:06.763106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 215/437] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:30:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:06.768350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:06.772944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:06.927786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee126e-939c-440f-b1da-0ee4fadfaa0c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:06.940307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50246-a77c-45dc-8dff-f837701ee4fd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:06.978736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:06.979836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.980129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.980409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.992957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:06.993501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:06.993786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:06.994060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:06.995996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:07.004689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:07.005586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:07.006782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 216/438] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:07.012778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.037876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.046224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.072817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.074302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.125690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46011b3-ddd8-4027-b646-ef567039906d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.163056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.163762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.164333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.164333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.165079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:07.165358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.166767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.179621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 217/439] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:07.180931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.187534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 223/440] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:07.192924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.267456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.273969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.288361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedab32-0712-44f0-abaf-079ef0b2576d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.297491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd9f65-8439-4865-af83-dac438aae9aa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.321847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.322511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.322793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.323069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.331834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a7e5-0cc1-49cf-8787-32e6ba05d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.332681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a7e5-0cc1-49cf-8787-32e6ba05d524 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.332963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a7e5-0cc1-49cf-8787-32e6ba05d524 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.333235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a7e5-0cc1-49cf-8787-32e6ba05d524 None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.334394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8a7e5-0cc1-49cf-8787-32e6ba05d524 None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.335856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8a7e5-0cc1-49cf-8787-32e6ba05d524 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.337528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 224/441] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:07.338678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642ba1d-3f84-49a0-af41-504dfee463b9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.338956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642ba1d-3f84-49a0-af41-504dfee463b9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.339227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642ba1d-3f84-49a0-af41-504dfee463b9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.340471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 225/442] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:07.343293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642ba1d-3f84-49a0-af41-504dfee463b9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.392134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.393592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.449197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642ba1d-3f84-49a0-af41-504dfee463b9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.479911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.484988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc173c8-e32e-4be7-a23b-2e31ab4f87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.485883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc173c8-e32e-4be7-a23b-2e31ab4f87e2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.486122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc173c8-e32e-4be7-a23b-2e31ab4f87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.486393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc173c8-e32e-4be7-a23b-2e31ab4f87e2 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.487633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc173c8-e32e-4be7-a23b-2e31ab4f87e2 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.489066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc173c8-e32e-4be7-a23b-2e31ab4f87e2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.490766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 226/443] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:07.491950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.492299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.492578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.502862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 218/444] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:30:07.502862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.510714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:07.511945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:07.514481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.583466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 227/445] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:07.584611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.607947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128e88-a5cf-4bec-8a73-4da44f660960 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.641386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.642033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.642320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.642591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.643440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=6a4dda1bb50c4b16ae906ea0a9870854, scope.project.id=6da87e604181436c81ef188a81ee128a) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:07.643752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.645173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.650861 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 219/446] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=6a4dda1bb50c4b16ae906ea0a9870854 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:07.651644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.691640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b54c7-b22b-42b6-8c45-96e199a77593 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.711699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.732626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.733600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.733840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.734057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] PATH_INFO: `/v3/projects/6da87e604181436c81ef188a81ee128a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.735350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] RBAC: Authorizing `identity:get_project(project_id=6da87e604181436c81ef188a81ee128a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.736899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.738720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 228/447] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/projects/6da87e604181436c81ef188a81ee128a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:07.744236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.755132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:07.772360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc27af-5b4b-43a5-9dd2-ea1fe07bdb56 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.812527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.813256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.813541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.813817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.824481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:07.833900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:07.834862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:07.835716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 220/448] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:07.840929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.866478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586dd6d-2da1-4af5-96a0-1a406ee9959f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.917593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:07.918454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:07.918741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:07.919015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] PATH_INFO: `/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:07.921805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] RBAC: Authorizing `identity:get_group(group_id=c3b1570bc47b4ea585ae2f1c1c9a411a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:07.923265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:07.924928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 229/449] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/groups/c3b1570bc47b4ea585ae2f1c1c9a411a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:07.931864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:07.974231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c304a-8434-4ace-b7a8-97e8533f50b3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:07.988054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:08.020857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:08.021494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:08.021653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:08.022036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:08.022468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:08.023634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:08.024094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:08.025734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:08.034690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 221/450] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:08.040133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:08.050903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d7e56-28b4-461d-b56f-84443f0886c1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:08.084633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:08.085213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:08.085494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:08.085764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:08.086588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] RBAC: Adding query filter params (group.id=c3b1570bc47b4ea585ae2f1c1c9a411a, role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=6da87e604181436c81ef188a81ee128a) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:08.086896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:08.088352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:08.094507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 230/451] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:30:07 2022] GET /identity/v3/role_assignments?group.id=c3b1570bc47b4ea585ae2f1c1c9a411a&scope.project.id=6da87e604181436c81ef188a81ee128a&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:08.142558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251ff0-cea0-407a-a08d-bc6fcc2ecf3a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:08.178625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:08.179272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:08.179587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:08.179860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:08.222989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:08.254101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:08.255600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:08.356080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 222/452] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:30:08.362198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:08.470979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217cc4-bd31-427a-b3fd-bda9948c7c4d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:08.503116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:08.503994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:08.504276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:08.504546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] PATH_INFO: `/v3/projects/bf189989f41048d2bcf89c6d65f2316e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:08.505707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] RBAC: Authorizing `identity:get_project(project_id=bf189989f41048d2bcf89c6d65f2316e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:08.507143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:08.508916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 231/453] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:30:08 2022] GET /identity/v3/projects/bf189989f41048d2bcf89c6d65f2316e => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:08.515063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:08.583893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:08.615345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ab2a-8d3e-4f28-a7a3-96a91ae30a10 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:08.648349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78916-9941-4d43-92d0-c74ed8b6e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:08.649195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78916-9941-4d43-92d0-c74ed8b6e617 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:08.649478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78916-9941-4d43-92d0-c74ed8b6e617 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:08.649755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78916-9941-4d43-92d0-c74ed8b6e617 None admin] PATH_INFO: `/v3/groups/5c58a191ccc84eeb953d16f3d8ff5694` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:08.650926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78916-9941-4d43-92d0-c74ed8b6e617 None admin] RBAC: Authorizing `identity:get_group(group_id=5c58a191ccc84eeb953d16f3d8ff5694)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:08.652394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78916-9941-4d43-92d0-c74ed8b6e617 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:08.654579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 223/454] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Jul 25 08:30:08 2022] GET /identity/v3/groups/5c58a191ccc84eeb953d16f3d8ff5694 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:08.660313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:08.668946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:08.759057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f9ec-256b-4244-ac2f-d5be8f867d8b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:08.792941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:08.793593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:08.793877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:08.794152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:08.795011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] RBAC: Adding query filter params (group.id=5c58a191ccc84eeb953d16f3d8ff5694, role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=bf189989f41048d2bcf89c6d65f2316e) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:08.795326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:08.796795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d27d5f-0faf-4039-8464-dbee9f42b37b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:08.802471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 232/455] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Jul 25 08:30:08 2022] GET /identity/v3/role_assignments?group.id=5c58a191ccc84eeb953d16f3d8ff5694&scope.project.id=bf189989f41048d2bcf89c6d65f2316e&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:11.374482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685563c-2ec7-45b7-8fc2-6f8ef9e39e2c None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.375029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685563c-2ec7-45b7-8fc2-6f8ef9e39e2c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.375029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685563c-2ec7-45b7-8fc2-6f8ef9e39e2c None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.377378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 224/456] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:11.385072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.385879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.386376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.418847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5abc9-121f-46e6-82cd-08fd6142828e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.418847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5abc9-121f-46e6-82cd-08fd6142828e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.418847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5abc9-121f-46e6-82cd-08fd6142828e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.423685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 225/457] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:11.425029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861ce58-dd56-4812-a13c-fee3acfc0499 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.425526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861ce58-dd56-4812-a13c-fee3acfc0499 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.426002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861ce58-dd56-4812-a13c-fee3acfc0499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.433701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:11.433701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:11.484475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b861ce58-dd56-4812-a13c-fee3acfc0499 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:11.496065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b861ce58-dd56-4812-a13c-fee3acfc0499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:11.622058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 226/458] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:11.626694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558626-9923-42d6-a617-9cadabcaa0e3 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.627205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558626-9923-42d6-a617-9cadabcaa0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.627718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558626-9923-42d6-a617-9cadabcaa0e3 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.629421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 227/459] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:11.634763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd38dd3-9414-4785-9073-718111760cba None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.635296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd38dd3-9414-4785-9073-718111760cba None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.635842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd38dd3-9414-4785-9073-718111760cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.675059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:11.676280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5bd38dd3-9414-4785-9073-718111760cba None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:11.678163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5bd38dd3-9414-4785-9073-718111760cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:11.680994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 233/460] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:11.681995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:11.821014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf6afe-a78d-4d91-8c90-603bf35d4e91 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:11.891834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:11.906657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:11.912002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:11.912501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:11.913006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:11.913815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 228/461] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:30:11.914914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd38dd3-9414-4785-9073-718111760cba None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:11.948534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:11.950327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:11.997106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:11.998584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:11.999452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:11.999452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:11.999452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:11.999452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:12.008743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 234/462] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:12.010608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.142739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:12.166647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd38dd3-9414-4785-9073-718111760cba None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.256534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.257345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.257626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.258086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.268938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.270653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:12.280326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ac2e-49d9-4b06-ba9e-8aaf51b98e67 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:12.303463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:12.304310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:12.305138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:12.305138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:12.305138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:12.305138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:12.308050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 229/463] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:12.309351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.328561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.329361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.329806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.330230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.343187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.344727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-119b9bf0-88f8-45b9-9df9-d7d7d330be50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:12.369140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:12.370156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:12.370985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:12.370985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:12.370985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:12.370985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:12.375760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 235/464] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:12.377217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf9c5-c496-4be1-9ebc-6b11be72ea5b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.377503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf9c5-c496-4be1-9ebc-6b11be72ea5b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.377915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf9c5-c496-4be1-9ebc-6b11be72ea5b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.379318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 236/465] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:12.383955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf9c5-c496-4be1-9ebc-6b11be72ea5b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.426642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:12.512054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ba485-f902-41c5-92d0-5c0309ea8469 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.524222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf9c5-c496-4be1-9ebc-6b11be72ea5b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.527492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:12.570102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.570804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.571062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.571340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.573198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:12.573198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.576971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:12.585257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.586119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.586496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.586905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.587910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:12.588312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.589846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910099-41cb-42e3-812d-06941c2ad9ed None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:12.593075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 237/466] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:12.594499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.612058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 230/467] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:12.613474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.614016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.614301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.634084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:12.636774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:12.718469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 231/468] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:12.719579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.736630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef626-7177-47e9-97ab-1773c1e067bc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.767035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:12.786954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.787688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.788225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.788655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.789754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:12.790268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.791692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:12.808288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 238/469] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:12.809389 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.840951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:12.844457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473a5f6-80b7-4d69-ad33-764f7810f474 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.889984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.890665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.890942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.891416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.892261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.894238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:12.918117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 232/470] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:30:12 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:12.919175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:12.930235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95572dc-8b86-4970-bae7-a4834551395f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:12.975630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:12.976620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:12.976904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:12.977180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:12.977907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:12.979573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:13.019618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 239/471] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:30:12 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:13.020841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:13.055029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:13.060538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ed53-aede-476b-b63f-b14cb9480f99 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:13.134921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:13.136182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.136878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.137417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.158871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:13.163510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:13.165822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:13.186033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727df89d-6e0e-4355-9597-3ad0a3ae7c66 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-56e19d1b-e161-4476-b812-090294edbd4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:13.192153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:13.192991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:13.193809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:13.193809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:13.193809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:13.193809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:13.195551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 233/472] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:13.196870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a909d-2cdf-48f7-b46e-842ac94ba21e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.197154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a909d-2cdf-48f7-b46e-842ac94ba21e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.197427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a909d-2cdf-48f7-b46e-842ac94ba21e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.199471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 234/473] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:13.201992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a909d-2cdf-48f7-b46e-842ac94ba21e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:13.250718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e89c1f-9ac9-43c4-9555-b46d75751878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:13.255411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e89c1f-9ac9-43c4-9555-b46d75751878 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.255411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e89c1f-9ac9-43c4-9555-b46d75751878 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.255411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e89c1f-9ac9-43c4-9555-b46d75751878 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.255411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e89c1f-9ac9-43c4-9555-b46d75751878 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:13.255411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e89c1f-9ac9-43c4-9555-b46d75751878 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:13.290718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 240/474] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:30:13 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:13.292597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.292892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.293198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.326566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:13.327913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:13.434331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 241/475] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:13.462252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:13.485115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a909d-2cdf-48f7-b46e-842ac94ba21e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:13.533054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:13.534278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.534703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.535133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.536050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:13.536496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:13.538474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:13.558114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:13.567442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 235/476] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:13.574079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:13.592890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:13.620138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0eca8-7c11-4a0e-b3ed-378810ff8be6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:13.673652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:13.674779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.675280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.675809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.676776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:13.678350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:13.693897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.sql.core [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 08:30:13.693897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 08:30:13.693897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [parameters: {'id': '3a744139ae4647da80332e8b6f4a3add', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 08:30:13.693897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80320) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 08:30:13.716132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b063-ca08-4a31-ade6-cefa4fa17360 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application result.read() Jul 25 08:30:13.716863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:30:13.717675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application yield resource Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise self.value Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application session.commit() Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 08:30:13.718639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.session.flush() Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application compat.raise_( Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 08:30:13.719481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:30:13.720337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application result.read() Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:30:13.721403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [parameters: {'id': '3a744139ae4647da80332e8b6f4a3add', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:13.722155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 08:30:13.722916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:13.730588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 242/477] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Jul 25 08:30:13 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:13.732927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:13.773529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:13.774701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.775229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.775568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.776283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:13.777946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:13.829322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 236/478] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:30:13 2022] POST /identity/v3/users => generated 249 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:30:13.879815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4c83-eae6-4967-a2af-de8ebd216a2c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:13.915773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:13.928219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728fc3b-a62e-4867-b668-ecb7464cf5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:13.929340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728fc3b-a62e-4867-b668-ecb7464cf5fa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:13.929768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728fc3b-a62e-4867-b668-ecb7464cf5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:13.930185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728fc3b-a62e-4867-b668-ecb7464cf5fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:13.952414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728fc3b-a62e-4867-b668-ecb7464cf5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9728fc3b-a62e-4867-b668-ecb7464cf5fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:13.961134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:13.962264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:30:13.963110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:13.965404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 243/479] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:13.972749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:14.084950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:14.120693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6201222-94bd-4986-a733-916fad87d50e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:14.157388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:14.158295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:14.158722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:14.159137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:14.160099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:14.160545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:14.162080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77696a-7b31-4faa-9bd1-bebf248b878b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:14.171528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 237/480] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:15.234113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caf7c8-d864-4e4b-b875-ddb7dda4060f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.234634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caf7c8-d864-4e4b-b875-ddb7dda4060f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.234994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caf7c8-d864-4e4b-b875-ddb7dda4060f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.236955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 244/481] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:15.252740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9bf4-1b41-4588-8439-b5b1c978157a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.253245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9bf4-1b41-4588-8439-b5b1c978157a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.253508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9bf4-1b41-4588-8439-b5b1c978157a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.275128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c2db9bf4-1b41-4588-8439-b5b1c978157a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:15.276347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c2db9bf4-1b41-4588-8439-b5b1c978157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:15.376715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 238/482] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:15.402953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caf7c8-d864-4e4b-b875-ddb7dda4060f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:15.610612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caf7c8-d864-4e4b-b875-ddb7dda4060f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:15.671918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543555-9957-41b6-a9d7-5826ac1ad617 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.672551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543555-9957-41b6-a9d7-5826ac1ad617 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.673028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543555-9957-41b6-a9d7-5826ac1ad617 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.678273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 239/483] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:15.679895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.680612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:15.680877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.681423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.681709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.681959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.682082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.700568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:15.702070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:15.712242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:15.720858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:15.721716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:15.722973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 245/484] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:15.729075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:15.807845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:15.816712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:15.830369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 240/485] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:30:15.877079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:15.885603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b355-849e-4014-a67c-54fa17bbe4e6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:15.928350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:15.929019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.929301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.929572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.930686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:15.931000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:15.932767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f069f7-0696-4be4-9e12-8ae1a630c973 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:15.943469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 246/486] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:15.948072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78ea4-2c0d-4ff1-8a87-ca6de4761dbf None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:15.948072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78ea4-2c0d-4ff1-8a87-ca6de4761dbf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:15.948072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78ea4-2c0d-4ff1-8a87-ca6de4761dbf None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:15.948072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 247/487] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:15.952251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d78ea4-2c0d-4ff1-8a87-ca6de4761dbf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.005721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77cbb-85ab-4245-a908-bbbb550b3ca8 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.042119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b3410-1a43-4ff3-a56f-84a1e676b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.042700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b3410-1a43-4ff3-a56f-84a1e676b82d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.042987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b3410-1a43-4ff3-a56f-84a1e676b82d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.043261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b3410-1a43-4ff3-a56f-84a1e676b82d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.054189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b3410-1a43-4ff3-a56f-84a1e676b82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-450b3410-1a43-4ff3-a56f-84a1e676b82d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:16.068224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:16.069118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:16.069873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 241/488] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:16.071041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.071258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.071576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.075490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d78ea4-2c0d-4ff1-8a87-ca6de4761dbf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.090213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.092162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:16.093372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:16.115014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.116211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.116715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.117180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.129073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.130990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.140826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:16.152876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:16.153696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:16.155091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:16.155091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:16.155091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:16.155091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:16.161957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 248/489] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:16.163138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.176322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 242/490] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:16.179901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.278666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4970081-5631-4725-96b8-b8fb3994b79a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.315419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0a695-b31f-49b0-be73-860c92e93b11 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.327307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.328402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.328905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.329371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.330419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:16.331015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.332753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.343982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 249/491] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:16.345168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.352920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.353596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.353881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.354163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.354902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:16.355212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.356632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.373666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 243/492] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:16.373666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.383741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.416922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.474857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8fc1e-8242-4196-a60e-e3ed5d5c47ee None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.490441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f800e-2ba5-42fa-9130-d351c0250ea0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.511972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.512778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.513069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.513904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.526569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:16.532387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:16.533420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:16.534187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 250/493] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:16.534825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.535829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.536627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.536909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.537182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.551913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.553387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8f5d917a-67c9-49ad-87ee-aec921d51f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:16.571970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:16.572930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:16.573737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:16.573737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:16.573737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:16.573737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:16.578391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 244/494] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:16.579665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb1fc-c8ea-486a-bbfb-3d14ad1af087 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.579950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb1fc-c8ea-486a-bbfb-3d14ad1af087 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.580225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb1fc-c8ea-486a-bbfb-3d14ad1af087 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.581623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 245/495] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:16.586129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb1fc-c8ea-486a-bbfb-3d14ad1af087 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.635997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.651119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739387e-adcd-424b-bc5b-4ce6f5e6abf4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.687857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.690082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.690875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.691229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.691563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.699992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.701473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.702164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb1fc-c8ea-486a-bbfb-3d14ad1af087 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:16.717022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:16.717889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:30:16.718765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:16.723271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 251/496] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:16.724162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.745350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.746009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.746292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.746567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.747306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:16.748414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.749576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10149-183c-486e-8307-2ee392ddb0c4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.762320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 246/497] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:16.762320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.762320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.762320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.779268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:16.780489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:16.840690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919734d8-ae23-4715-8ff0-de5fbfb9e6e5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:16.852461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 247/498] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:16.853655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.886686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:16.887484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:16.887838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:16.888115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:16.889045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:16.889354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:16.890762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:16.903608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 252/499] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:16.907150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:16.916085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.949532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:16.968514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f6d6-a81f-46bd-bace-a85d76efbd4c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.002296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.002961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.003242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.003549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.004383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:17.004688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.006113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.008454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655745-d8d6-419a-8203-0102385d0b2c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.041522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.042343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.042487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 248/500] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:17.042654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.042897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.043165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.056140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.057614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:17.074785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:17.075704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:17.076567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:17.076567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:17.076567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:17.076567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:17.076567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 253/501] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:17.076820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.134793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.141864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33be0b-c6cd-4f16-be61-1f7de05b5c78 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.181226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdc10-812b-41d4-8193-35ffbd426603 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.182710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5678f-f29d-4169-b1ff-169616180849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.183533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5678f-f29d-4169-b1ff-169616180849 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.183815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5678f-f29d-4169-b1ff-169616180849 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.184088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5678f-f29d-4169-b1ff-169616180849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.191659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.194962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5678f-f29d-4169-b1ff-169616180849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-2db5678f-f29d-4169-b1ff-169616180849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:17.203287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:17.204280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:17.205067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 249/502] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:17.205754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcee83-3342-40df-898d-a81b7f1c3210 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.206090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcee83-3342-40df-898d-a81b7f1c3210 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.206311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcee83-3342-40df-898d-a81b7f1c3210 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.211535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 250/503] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:17.211535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcee83-3342-40df-898d-a81b7f1c3210 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.220471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.221521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.221806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.222087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.229307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.230762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:17.245573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:17.246478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:17.247355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 254/504] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:17.247931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.311542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcee83-3342-40df-898d-a81b7f1c3210 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.345879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9f70-07a3-4fb8-9338-b1ff67cb347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.346600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9f70-07a3-4fb8-9338-b1ff67cb347d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.346891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9f70-07a3-4fb8-9338-b1ff67cb347d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.347170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9f70-07a3-4fb8-9338-b1ff67cb347d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.349055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcecd-8365-410a-8464-732c56a49f54 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.368616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.385495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.386090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.386368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.386637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.387354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:17.387682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.389575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.400418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 255/505] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:17.401185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.414117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.416766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9f70-07a3-4fb8-9338-b1ff67cb347d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.418756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9f70-07a3-4fb8-9338-b1ff67cb347d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.501474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043032b-374d-436c-a3f2-7920aa602c61 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.518883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 251/506] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:17.521416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.522133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.522629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.541111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.541785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.541883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:17.542070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.542346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.543022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:17.543110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:17.543418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.544842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.553724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 256/507] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:17.554541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.597003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.616895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 252/508] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:17.617739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.652397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.665796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e320e05-6b2b-4dd6-a8d7-1bbe3858a46d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.701312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.701975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.702261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.702535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.703365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:17.703700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.705126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.722151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d560a9a-ec57-4034-a17b-7ccd9b08ef5e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.740940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 257/509] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:17.741747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.759824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.760619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.760904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.761179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.768926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.770358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:17.786097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:17.787176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:17.788137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 253/510] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:17.788673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.840646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.844409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bf432-41fb-4324-a176-1bb166730a9d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.879243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:17.881124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.882053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.882401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.882735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.889948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8c37-e3da-4dd3-915a-5636553a9109 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:17.894051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.895551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:17.913416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:17.914395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:17.915455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:17.915455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:17.915455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:17.915455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:17.915455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 258/511] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:17.915779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:17.933134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:17.933925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:17.934204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:17.934478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:17.945254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:17.946708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:17.964485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:17.965481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:17.966471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:17.966471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:17.966471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:17.966471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:17.966471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 254/512] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:17.966471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.019412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bffe8-83b7-4ace-94c3-a2c9f216b824 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.051417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.052223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.052503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.052779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.063634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.065032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985798-813a-4ad7-84ab-8c1a7d73d47a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.065149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:18.082239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:18.083237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 259/513] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.104739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.105596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.105885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.106168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.118659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.175582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.176954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.195156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4139bd-08eb-4361-8651-323cb7d8b90f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.229629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.230290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.230573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.230845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.231709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:18.232816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.234302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.252571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 260/514] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:18.253356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.279873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 255/515] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:18.280776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.312848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.329050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.359247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db659-3f39-449b-8ee5-a31b906abc10 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.385866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65297772-8c91-4efd-a835-efaaa1543568 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.402131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.402904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.403193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.403500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.404274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:18.404581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.405956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.417053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 261/516] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:18.417827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.419201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.420417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.420922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.421770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.421915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:18.422264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.423598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.436711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 256/517] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:18.437311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.525334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771245-344a-416a-a2ea-89cb71598f48 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.543850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a75fba-60f6-42d7-9c8a-49c8f446d7fc None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.545967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.549717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.564759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.565420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.565705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.565983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.566705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:18.567013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.568425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.579314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.579982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.580100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 262/518] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:18.580270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.580535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.580775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.647855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.649323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.684675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cc5d-8e74-4e3f-8a46-8e44d9aba0c0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.718384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.719106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.719406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.719688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.729881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.731321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.745863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 257/519] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:18.746519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.748937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:18.753777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:18.754696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:18.755562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:18.755562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:18.755562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:18.755562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:18.755562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 263/520] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:18.755934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.786740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:18.850254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666f1cd-8bf3-419c-b0bb-99bfd2323214 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.864281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c80e2-110c-45a4-9e9f-cd9b8be70837 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:18.884588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.885379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.885661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.885934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.893183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.894634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.898153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:18.899211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:18.899537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:18.899839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:18.907441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:18.908894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:18.909273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:18.910074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:18.910911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 258/521] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:18.911825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:18.927619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:18.928521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:18.929407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 264/522] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:18.929949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:18.981279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.020164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.021339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a116062-0e7c-414a-b99b-f717e023710d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.029681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994741-cc4e-466c-8cfb-79bcf96beb76 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.054879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.055569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.055851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.056130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.056831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.058271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.063653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.064440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.064721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.064993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.076576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.078048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.089733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 259/523] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:30:18 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:19.089733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:19.109067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:19.110236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:19.111487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:19.111487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:19.111487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:19.111487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:19.111487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 265/524] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:19.112561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.207064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff605928-7987-48d8-b074-cf11b7beeffd None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.228120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.240677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af530b92-9905-4448-bcab-313bc2e5f1fb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.251373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.252100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.252390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.252670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.253411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:19.253722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.255107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.271023 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 260/525] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:19.272387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.285491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.286303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.286675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.287736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.288761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:19.289158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.290692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.315418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 266/526] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:19.315418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.319921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.394068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b172-6570-4bcf-ac55-c854cf3dba1d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.431212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.432490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.432925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.433349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.433459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d415d-0e1f-42ec-8dc3-7209a852e88a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.434770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:19.435796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.437377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.460495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 261/527] 10.222.0.57 () {56 vars in 1139 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:19.460495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.469447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.470249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.470907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.471285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.472146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:19.472555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.474038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.487637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 267/528] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:19.488384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.501240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.562423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.582768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db02f-c74a-49bc-9298-531754d90103 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.608478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1227b-d44f-442a-8536-209a4799e004 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.624136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.625272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.625616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.625957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.637331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.638843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.647347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.648099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.648452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.648796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.649700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=a758c6680078465d8d65ffd105594530) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:19.650083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.651600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:19.655052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:19.656067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:19.657106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:19.658136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 262/529] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:19.658924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.667500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 268/530] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/role_assignments?user.id=a758c6680078465d8d65ffd105594530&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:19.667500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.798925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.806477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27028fed-ba8b-4141-9dc1-4869d3b733ea None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.849762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17768d7-203f-4805-afed-2abd6282f93c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:19.853366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.854194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.854626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.855078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.889953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:19.890755 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:19.891155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:19.891289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:19.898293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.899596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:19.915495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:19.916383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:19.917240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:19.918143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:19.927422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 269/531] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:19.927422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:19.947438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:19.948515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.049655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefe06a-a6a9-462b-9c0d-89dcbe6f4d7a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.062377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:20.069359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 263/532] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:20.070397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:20.101622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.102295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.102583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.102867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.103957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:20.104273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.106474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.127756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 270/533] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:20.127756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:20.192630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:20.204310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afcfc5-64d2-4e3f-9834-5e2aebed35b8 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.255015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468222d8-2f81-4bc5-8aa8-6d2159c1a60b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.261039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.261964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.262472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.263024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.264631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:20.265251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.267013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.287721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 264/534] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:20.288917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:20.299175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.300075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.300307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.300584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.318262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.320437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:20.348042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:20.348904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:20.349721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:20.349721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:20.349721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:20.349721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:20.349721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 271/535] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:20.350429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:20.362227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:20.409984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95b84-1983-439d-b5c9-7d83483a3560 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.448587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.449732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.450243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.451249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.452340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=17968a13a13d4ad49956f1276256e8c6) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:20.452858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.454523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.460954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 265/536] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/role_assignments?user.id=17968a13a13d4ad49956f1276256e8c6&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:20.462073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:20.518300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:20.531049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21a2f1-e182-4680-b858-acc36d6f7705 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.619008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c01b-20bc-4f81-bf79-9c11ccf4a643 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.642883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:20.662813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.662813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.662813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.662813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.663273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=0a6925d9c52e4bf9ab900755b8aac7fb) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:20.663273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.663273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.670856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.671707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.672138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 272/537] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/role_assignments?user.id=0a6925d9c52e4bf9ab900755b8aac7fb&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:20.672490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.672869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.673778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:20.674189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.675747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.705699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 266/538] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:20.711154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:20.895358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2a03c-c205-453f-b5fc-6e2c45649efd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:20.931419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:20.931617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:20.931830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:20.935615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:20.939721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:20.941218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-2586f90e-16bf-42b2-8baa-08955ecada49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:20.958977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:20.959871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:20.961131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 273/539] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:20.967461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:21.200682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa026-90a2-49a3-993c-c22e9f425e26 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.201048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa026-90a2-49a3-993c-c22e9f425e26 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.201238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa026-90a2-49a3-993c-c22e9f425e26 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.202839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 274/540] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:21.207605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.207892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.208168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.228850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:21.230038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:21.253849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:21.255169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e625-ede2-49a5-8805-5ff23b74371c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:21.314003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 275/541] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:30:21.336195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:21.340780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3568-f164-4514-b001-89b79ab167db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:21.341579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3568-f164-4514-b001-89b79ab167db None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.341861 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3568-f164-4514-b001-89b79ab167db None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.342134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3568-f164-4514-b001-89b79ab167db None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.342982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d3568-f164-4514-b001-89b79ab167db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:21.343292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d3568-f164-4514-b001-89b79ab167db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:21.344903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d3568-f164-4514-b001-89b79ab167db None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:21.359492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 267/542] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:21.365331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3568-f164-4514-b001-89b79ab167db None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:21.451810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:21.565376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0fca-a5cd-4c68-9996-5844d32c06bd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:21.583343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3568-f164-4514-b001-89b79ab167db None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:21.637959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6c943-9ad5-4565-a5c3-e24a63e6a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:21.638791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6c943-9ad5-4565-a5c3-e24a63e6a191 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.639069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6c943-9ad5-4565-a5c3-e24a63e6a191 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.639342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6c943-9ad5-4565-a5c3-e24a63e6a191 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.651525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:21.652178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.653179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.653462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.654895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=1d85eeb2282b4f9ca9f357c0e0948de0) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:21.655226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:21.656698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:21.664069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6c943-9ad5-4565-a5c3-e24a63e6a191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:21.676262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 268/543] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:21 2022] GET /identity/v3/role_assignments?user.id=1d85eeb2282b4f9ca9f357c0e0948de0&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-47e6c943-9ad5-4565-a5c3-e24a63e6a191 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:21.677156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:21.678005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:21.679186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 276/544] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:21.684652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:21.882645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd0ce-daf9-4b75-b830-2f6061f330f6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:21.889216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:21.936301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:21.936846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.937126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.937506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.938157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:21.938573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:21.940086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:21.960161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 269/545] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:21.963873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135714-367f-429c-9b4e-851e09ea8715 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.964467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135714-367f-429c-9b4e-851e09ea8715 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.964988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135714-367f-429c-9b4e-851e09ea8715 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:21.965218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:21.971576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 277/546] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:21.973522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:21.974009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:21.974477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.002123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:22.005341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:22.024936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:22.164722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee1bb-45a3-462d-8242-639106f49123 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:22.175419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 278/547] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:22.209980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:22.253145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:22.254336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.254825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.255301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.286638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:22.290729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:22.331552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:22.332425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:22.333241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:22.333241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:22.333241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:22.333241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:22.338830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 270/548] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:22.343089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:22.383744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:22.426378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac90ddc-85af-4423-aeae-c5f5e5c00259 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:22.504370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:22.506087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.506087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.506087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.533073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:22.555769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:22.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:22.557962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:22.561485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044dfaf-b0a8-42d8-b846-57ff688a32e6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:22.562430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 279/549] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:22.567914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:22.575778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:22.638532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:22.639211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.639526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.639809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.640548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:22.644343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:22.646771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:22.671605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 271/550] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:22.677086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:22.758078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fc385-4026-4ff7-842a-a2891713daf6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:22.787630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:22.797691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:22.799432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.799923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.800400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.801473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:22.802091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:22.803697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923aa5d-2546-42c9-b6ed-098cbd483a82 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:22.811618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bb376-6918-418c-a810-4536fe146cab None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:22.814089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 280/551] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:22.815593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e479-2b81-4a19-b46d-cd102104a58a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.816111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e479-2b81-4a19-b46d-cd102104a58a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.816599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e479-2b81-4a19-b46d-cd102104a58a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.822179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 281/552] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:22.823291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187e479-2b81-4a19-b46d-cd102104a58a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:22.860430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:22.860896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.861187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.861467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.874063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:22.875606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-827c8e78-0802-4283-9019-89772ad4b0dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:22.895414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:22.896363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:22.897359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:22.899967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 272/553] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:22.903408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:22.903408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:22.903408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:22.922815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:22.924064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:22.971238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.007720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 273/554] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:23.009141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.094509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187e479-2b81-4a19-b46d-cd102104a58a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.109266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.136016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.136832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.137117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.137399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.148384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:23.149726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702a03-5005-4fa8-bd0b-702681959764 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.149901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:23.167520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:23.168422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:23.169392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:23.169392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:23.169392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:23.169392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:23.169392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 282/555] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:23.170242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.199108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.200102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.200388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.200658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.201535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:23.201840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:23.203544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e00d72-19f1-4502-9819-7167a5de176b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:23.227619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 274/556] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:23.229191 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64569d27-108f-4428-8266-af3770a465bf None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.229686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64569d27-108f-4428-8266-af3770a465bf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.230162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64569d27-108f-4428-8266-af3770a465bf None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.231955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 275/557] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:23.233457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64569d27-108f-4428-8266-af3770a465bf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.320866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc4e3-4eeb-43e5-9793-bac9ce5df5f5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.341959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.360200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64569d27-108f-4428-8266-af3770a465bf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.364208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.365009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.365291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.365564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.379032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:23.385440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:23.390097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:23.391015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 283/558] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:23.397993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.402238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.402907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.403247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.403558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.405841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:23.405841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:23.406566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a23d-e61e-44cb-a3b6-f6c82ff2925d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:23.420040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 276/559] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:23.421313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.421603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.421880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.439460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:23.440645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:23.511776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 277/560] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:23.511776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.518497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d190c8e-470e-4ed8-a27c-60e2f3821da2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.565182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.565961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.566554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.566938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.622020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.642535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1b122-bb70-4661-808f-0fc4fb954f92 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.647765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:23.649359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:23.660223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.681721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.682401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.682690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.682972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.683763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:23.684585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:23.686074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:23.694771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 278/561] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:23.695604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.766222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 284/562] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:23.767013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.809282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1392b1-e22a-4b90-a218-0c8c13628a4d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.847080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.847920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.848206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.848479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.854096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.856964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:23.858521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:23.873264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:23.874222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:23.875116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 279/563] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:23.876393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.883932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285065e3-b7a7-4b41-b365-7b9b33bf4edd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:23.917472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:23.919648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:23.920666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:23.920877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:23.921152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:23.931663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:23.940074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:23.941063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:23.941881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 285/564] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:23.942555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:23.991533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d573c71-2b31-427e-8625-be94bd92b6fc None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.030947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.031681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.031966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.032249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.042645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.043864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f5189-4c59-4cca-bb21-f6fd19fdcbb0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.044126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:24.061977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.063068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.064179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:24.064179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:24.064179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.064179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:24.064179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 280/565] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.064179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.081962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.082760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.083038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.083323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.089916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.095093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.096866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-39b1b5c8-cde2-4276-90f8-4edf5934a292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:24.114753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.115826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.117132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:24.117132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:24.117132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.117132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:24.117132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 286/566] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.117132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3933-382d-48dd-9cb6-e07509ccd876 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.117529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3933-382d-48dd-9cb6-e07509ccd876 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.117686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3933-382d-48dd-9cb6-e07509ccd876 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.119526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 287/567] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:24.120480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d3933-382d-48dd-9cb6-e07509ccd876 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.159474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.169395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69acf7-bf4f-4d84-849f-4755b305bba3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.203444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.204333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.204775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.205055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.205899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:24.206209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.207648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.224495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 281/568] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:24.224847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d3933-382d-48dd-9cb6-e07509ccd876 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.225279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.262250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.262920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.263205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.263543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.264293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:24.264604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.266026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.274530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 288/569] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:24.275144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.328979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5e21-c00f-462d-a09e-e368adb1bffd None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.329149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.363666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.364322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.364606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.364884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.365609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:24.365919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.367303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc65a-ca08-4c08-a8ba-0a0080fdea44 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.377508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae147-6678-4d41-97b2-660b293c4912 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.380981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 282/570] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:24.382223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.382507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.382781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.399752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:24.400926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:24.402823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.411875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.412543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.412828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.413101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.413825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:24.414129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.415623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.428062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 289/571] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:24.428841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.469787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 283/572] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:24.471054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.545344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c280f9-43d5-4bb6-a712-8fc8057ad26c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.558886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.571531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ba4b-e5f8-4317-9048-ca9a98ba25c7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.579958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.580691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.580971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.581240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.591307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.593431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.605901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.606691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.606973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.607824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:24.611791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.612791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.613691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:24.613691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:24.613691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.613691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:24.613691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 290/573] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.613960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.618221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.619837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.620424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:24.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.641840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.643130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:24.643130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:24.643130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:24.643130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:24.643130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 284/574] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.643466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.717347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056043a-19b0-4e9d-8160-6d2b9e6766ca None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.742302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ff48-5f97-4bf3-bd15-c6ea8bee501d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.752806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.753601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.753887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.754167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.761190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.762637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.775156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.775961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.776245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.776517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:24.776982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.777879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:24.778806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:24.783205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 291/575] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.784049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.785368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.786812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:24.801161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.802137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:24.803015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 285/576] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.803524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.812895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.853676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:24.887037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad822a3-703a-458b-a5d8-fb7f9fb2dc57 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.905316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a61ff-b718-4fab-a813-c0e952c59031 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:24.925251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.926049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.926332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.926606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.936738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:24.939702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:24.940354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:24.940638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:24.940915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:24.941633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:24.941941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:24.943309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:24.944416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:24.945488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:24.946334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 292/577] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:24.947026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:24.958346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 286/578] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:24.959155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.036228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.051906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb632-26dd-4238-a929-67111a4e94c9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.056956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa6fb-00a1-46dd-9a39-a2bc4b2c19af None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.067813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.086485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.087152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.087469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.087746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.088467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.088776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.090157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.092282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.092949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.093225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.093498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.094331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.094639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.096335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.103451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 293/579] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.104184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.117539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 287/580] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:30:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.118347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.202173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc5f0c-b9d1-4cd1-81b3-da7be88dc5ea None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.215718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af830d-32cf-466a-9962-43042d8070e6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.238305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.238966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.239251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.239697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.240581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.240898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.242577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.249810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.250463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.250843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.251118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.251885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.252188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.253569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.255097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 294/581] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.255918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.260999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.267214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 288/582] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.268245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.297258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.365782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85b0e-00e1-42a3-8c4f-56ed42b3ab19 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.370424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84bad-780d-4321-bc9c-3eba667362c8 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.399585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.400375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.400654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.400928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.404866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.405661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.405948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.406227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.407779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.409217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.413660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.415081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:25.423486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:25.424508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:25.425380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:25.427532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 295/583] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:25.428489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:25.429222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:25.430100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:25.430996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 289/584] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:25.431616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.490687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.521612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.531206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38547f9-b0b4-4933-be04-5f6ffc8a5b41 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.533040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a5c7-6a33-4e49-8c2d-4ff7e7683b22 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.567597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.568254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.568538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.568817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.569657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6da2eb51566940d7bee3a44f019e06ba) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.569971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.570526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.571314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.571448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.571624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.571898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.577357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 290/585] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/role_assignments?user.id=6da2eb51566940d7bee3a44f019e06ba&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.578129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.582651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.584198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:25.611699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:25.613239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:25.614114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:25.614114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:25.614114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:25.614114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:25.614114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 296/586] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:25.614383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.718447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddac40-6bc0-4767-8c63-b9e605ab5434 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.733428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1a3e-9a88-4a2f-b794-37e70ef6a8f6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.752798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.758854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.759688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.759976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.760279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.774563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.776071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.777028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.778009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.778582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.778959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.779792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.780102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.781514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.798619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 297/587] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:25.798794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:25.799781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:25.800635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:25.800635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:25.800635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:25.800635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:25.800859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.800951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 291/588] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:25.800951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.810763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:25.909822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391247eb-57ab-4d04-9a5f-d5c22df6bcf6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.910263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c650-54c2-456c-9006-1595b1bf0c7c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:25.945753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.946340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:25.946585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.946945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.947212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:25.947315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.947646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:25.947988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:25.948262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.948649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.949029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:25.949408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:25.950211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.950992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:25.968143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 292/589] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.968143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:25.973759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 298/590] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:25.978491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.016226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.041301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.076173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59425f-1141-4603-a8d1-fdf723b47524 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.095104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ee2f-e0a8-4ed4-89d9-d17b2d590acb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.116071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.116969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.117252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.117523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/a758c6680078465d8d65ffd105594530/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.131806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=a758c6680078465d8d65ffd105594530, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.132203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.132958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.133243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.133340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.133634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.134416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:26.134790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.136250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.146807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 293/591] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:25 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/a758c6680078465d8d65ffd105594530/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:26.147836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.148370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 299/592] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:26.149195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.270612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b147-95f1-4949-b2e1-bd2d6b96d10a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.290887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.308490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.321276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142fd1-e86e-4a57-a917-c5b668edf435 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.329577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.330387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.330667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.330987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.342100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.343561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:26.359128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:26.360057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:26.360909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 294/593] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:26.361875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.367963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.370392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.370392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.370392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.382849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.384355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:26.402592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:26.403512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:26.404959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:26.404959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:26.404959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:26.404959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:26.404959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 300/594] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:26.405658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.499411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842eb87-4bf4-46ed-a706-17fd7e91f3c2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.534102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4f34b-83a7-4b71-a2b0-98377e0b0924 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.547112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.553492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.553492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.553492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.562435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.564481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.573274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.573936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.574220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.574493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.575284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:26.575639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.577915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:26.582620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:26.584680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 295/595] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:26.586836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.595806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 301/596] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:26.596895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.606311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.632190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.710819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5031-8530-465a-a706-b33b2318c02c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.735725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c974ab-76c4-41c1-929f-a3258a83a9ff None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.761024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.761696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.761979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.762253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.763319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:26.764220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.765599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.778932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 296/597] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:26.783679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.783814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.784835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.785321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.785822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.787157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:26.788614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.790266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.814562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 302/598] 10.222.0.57 () {56 vars in 1139 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:26.815865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:26.891210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.897191 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abfc17-98dc-4ec9-8c09-4936a6512966 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.903286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:26.944811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.945976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.946263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.946544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/17968a13a13d4ad49956f1276256e8c6/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.948432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4596-9e40-4d0d-aed0-7d22363a3122 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:26.972932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=17968a13a13d4ad49956f1276256e8c6, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:26.974678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:26.988691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:26.989826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:26.990305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:26.990772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:26.995449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 297/599] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:26 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/17968a13a13d4ad49956f1276256e8c6/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:26.995449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:27.010090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:27.014185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:27.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:27.044336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:27.045257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 303/600] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:27.053701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:27.236452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05c843-4f39-46bc-a2a1-006ed30d92fc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:27.267235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:27.271623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa0783-162f-46d8-b983-46b3f45e5038 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:27.283367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:27.284668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.286135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.286638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.289849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:27.290412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:27.292788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:27.318207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 304/601] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:27.324316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:27.324463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:27.325113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.325395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.325670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.336785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:27.338300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:27.345661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:27.359242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:27.360183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:27.361030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:27.361030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:27.361030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:27.361030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:27.361030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 298/602] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:27.367012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:27.547857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60776ab-61da-43d6-8911-f4380e02b1c0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:27.576288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003606-8b15-4384-b5eb-a55e47ab5749 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:27.614773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:27.618127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.618507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.618876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.619742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:27.620341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:27.622922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:27.653467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 299/603] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:27.655755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:27.668718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc2fc-8a60-4257-879b-beaad35dee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:27.670432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc2fc-8a60-4257-879b-beaad35dee1f None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.670858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc2fc-8a60-4257-879b-beaad35dee1f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.671273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc2fc-8a60-4257-879b-beaad35dee1f None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/0a6925d9c52e4bf9ab900755b8aac7fb/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.724414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cc2fc-8a60-4257-879b-beaad35dee1f None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=0a6925d9c52e4bf9ab900755b8aac7fb, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:27.726841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cc2fc-8a60-4257-879b-beaad35dee1f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:27.759604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 305/604] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:27 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/0a6925d9c52e4bf9ab900755b8aac7fb/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:27.765810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:27.778161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7433fc-fca8-480a-b630-87b917e65e89 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.778376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7433fc-fca8-480a-b630-87b917e65e89 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.778583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7433fc-fca8-480a-b630-87b917e65e89 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.780711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 306/605] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:27.786449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.786733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.787017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.808417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:27.809670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:27.821336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43791-0d92-494b-aa07-d4d863e818c1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:27.862326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:27.863514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:27.863998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:27.864667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:27.875944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:27.881278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:27.885569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:27.920840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:27.921795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:27.922663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:27.927455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 300/606] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:27.935908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:27.979743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 307/607] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:28.000788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:28.090178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e7452-1517-41c7-a66b-d87cc3b7556e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:28.113256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:28.136379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b27f-7560-43e4-a0bb-18f45f45671f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:28.157474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:28.158193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.158477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.158747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.159578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:28.159888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:28.161353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:28.183810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 301/608] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:28.190262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:28.239412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:28.239412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.239412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.239412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.279162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:28.299979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:28.301036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:28.301858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 308/609] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:28.308794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:28.348160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558a70e-674c-496d-8f87-b4fb5748f0ad None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:28.389102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:28.404761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fb767-ab8b-493a-bbfb-6859b2bde9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:28.405685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb767-ab8b-493a-bbfb-6859b2bde9da None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.405972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb767-ab8b-493a-bbfb-6859b2bde9da None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.406248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb767-ab8b-493a-bbfb-6859b2bde9da None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/1d85eeb2282b4f9ca9f357c0e0948de0/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.437418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fb767-ab8b-493a-bbfb-6859b2bde9da None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=1d85eeb2282b4f9ca9f357c0e0948de0, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:28.438894 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fb767-ab8b-493a-bbfb-6859b2bde9da None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:28.488875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f884-6260-4702-a17d-bc4513a0d136 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:28.491647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 302/610] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:28 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/1d85eeb2282b4f9ca9f357c0e0948de0/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:28.536181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648069a-a598-4f75-aa8e-3bd99c4beafc None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.536814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648069a-a598-4f75-aa8e-3bd99c4beafc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.537324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648069a-a598-4f75-aa8e-3bd99c4beafc None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.539354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 303/611] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:28.545125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.545766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.546262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.559132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:28.560678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.561197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.561665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.562636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:28.563150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:28.564817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:28.576608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 309/612] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:28.587170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:28.604208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:28.605890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:28.707099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:28.727516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1c408-1a0a-4b84-bfb5-4ef77780740f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:28.727993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:28.770433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 304/613] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:28.786258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:28.786258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:28.786258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:28.786892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:28.809745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:28.811800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:28.824464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:28.831690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:28.832566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:28.833418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:28.833418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:28.833418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:28.833418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:28.833418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 310/614] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:28.840861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.023371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af827688-5c8f-4267-bdba-bb5be90ec2c9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.047683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a04ff-f5d4-42f3-8074-47eb5b3a755a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.094448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.095259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.095565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.095838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.112905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.113576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.113854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.114129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.115468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:29.115468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:29.116536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:29.121739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:29.129556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:29.130936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:29.131975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:29.132766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:29.134861 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 305/615] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:29.140904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 311/616] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:29.143833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.148769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.171442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:29.270293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c700a6-37d1-44de-b1b8-483bd189e557 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.355082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c5af-ff58-4dfd-9cb1-bcdf340bda26 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.392294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.392905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.393144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.393374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.394148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:29.394457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:29.397068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:29.419197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.421023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.421556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.422298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.429701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 306/617] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:29.431090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.442014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:29.443823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:29.465141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:29.466099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:29.467076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 312/618] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:29.474700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.544198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:29.593213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e5da-cc71-4c27-872e-abb4f7c19226 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.630979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.631650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.631900 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.632169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.633009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:29.633317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:29.634754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:29.654658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 313/619] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Jul 25 08:30:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:29.668043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.707258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:29.753493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b084-619d-4ab3-9f64-852f56cc705f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.793370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae317d-8a5a-4306-90a1-580e5303f65c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:29.812826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:29.818909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.819813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.820101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.820377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.836659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:29.839630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:29.840572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:29.842083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.842941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.843358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.864280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:29.868764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-02e3721e-39dc-40bc-bccd-2bd54b6258cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:29.874967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:29.875974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:29.876826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:29.876826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:29.876826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:29.876826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:29.886080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 307/620] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:29.887620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3eeac-76d5-43ae-bb4c-629f77fd7313 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.890004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3eeac-76d5-43ae-bb4c-629f77fd7313 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.891686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3eeac-76d5-43ae-bb4c-629f77fd7313 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.893666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 308/621] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:29.896596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3eeac-76d5-43ae-bb4c-629f77fd7313 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-b3388623-cea5-4fd8-b0d1-465260b99944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:29.903500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:29.905091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:29.905951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:29.905951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:29.905951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:29.905951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:29.916708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 314/622] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:29.918339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:29.921392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:29.921908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:29.953399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:29.956535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:30.091054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 315/623] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:30.094322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.118649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3eeac-76d5-43ae-bb4c-629f77fd7313 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.180347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:30.190237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.191199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.191865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.192463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.193454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:30.194801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:30.196274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:30.219534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 309/624] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:30.219534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.269751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:30.274268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d604b-63dd-4259-aa04-47499b62f61d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.333333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.334467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.334949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.335473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.336498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:30.337002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:30.338665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:30.353129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 316/625] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:30.354436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.361952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e760f1-351c-48bc-8a0b-77685b07775c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.400879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262510-d9d6-41a2-8215-8bd64604d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.401863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262510-d9d6-41a2-8215-8bd64604d467 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.401996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262510-d9d6-41a2-8215-8bd64604d467 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.402224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262510-d9d6-41a2-8215-8bd64604d467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.414237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262510-d9d6-41a2-8215-8bd64604d467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-33262510-d9d6-41a2-8215-8bd64604d467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:30.422576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:30.424349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 310/626] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:30.425402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2197f45-2d5c-4a77-82df-4c0585b09c9a None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.426152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2197f45-2d5c-4a77-82df-4c0585b09c9a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.426152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2197f45-2d5c-4a77-82df-4c0585b09c9a None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.431532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 311/627] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:30.431532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2197f45-2d5c-4a77-82df-4c0585b09c9a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.477263 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084b88-5245-4277-9b6e-8dccc17a735b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.502534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:30.527596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.528762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.529085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.529411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.538221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:30.541172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:30.559342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:30.560923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:30.566702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 317/628] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:30.567376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.571164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2197f45-2d5c-4a77-82df-4c0585b09c9a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.590737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:30.614030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.615175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.616018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.617824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.626342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:30.627953 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-76a44cd9-5dda-4a81-a960-35f7722a3dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:30.643866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:30.644789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:30.645653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:30.650008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 312/629] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:30.651358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.651695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.652432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.677259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:30.678446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:30.699666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40de17e-85a3-4054-bec4-d8275318e81c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.744368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.745430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.745889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.746343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.747110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:30.747461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:30.749398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:30.760223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 318/630] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:30.761377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.768662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 313/631] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:30.769649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.856689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:30.885578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:30.909520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25de-e1a8-4ecc-8b3f-a36e3c9e3afc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.949837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a5d2-da28-4dab-83ea-d5ab8d20980b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:30.963163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.963886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.964172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.964450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.965294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:30.965606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:30.967082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:30.988634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 319/632] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:30.989501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:30.992282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:30.994372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:30.995428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:30.995428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:30.995742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:30.996051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.000206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.017452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 314/633] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:31.018287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.110870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce23f1e-1cc9-42ec-b18a-e75d4e5d56fc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.133551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a4cc2-d0c1-4d97-9001-5733cca6f607 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.135256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.154242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.155048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.155332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.155635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.162491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.170846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.172498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.175828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.176822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.177257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.177533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.189898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-73ac639d-1032-4387-8821-49b5503da965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:31.192483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:31.193357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:31.194222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:31.194222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:31.194222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:31.194222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:31.194222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 320/634] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:31.194994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01c1b6-bd19-4522-925e-749cf702b4ad None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.195198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01c1b6-bd19-4522-925e-749cf702b4ad None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.195574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01c1b6-bd19-4522-925e-749cf702b4ad None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:31.197736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:31.199102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 315/635] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:31.200531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.201578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 321/636] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:31.201804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01c1b6-bd19-4522-925e-749cf702b4ad None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.314365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe051-d78a-46b7-a67d-f4c51fd43c7e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.314557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01c1b6-bd19-4522-925e-749cf702b4ad None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.351379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.352098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.352383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.352658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.354115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.355071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.355590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.355870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6da2eb51566940d7bee3a44f019e06ba/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.374827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=6da2eb51566940d7bee3a44f019e06ba, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.376321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.387215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.389856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 322/637] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:31 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6da2eb51566940d7bee3a44f019e06ba/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:31.390892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.444084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.446154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.446312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.517583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd557f-89d9-4ab2-9c1f-eac41eb60c05 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.568408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.570164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.570468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.570746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.571515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:31.572337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.573597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5846-1d9d-496f-8b5f-ef4561fafe14 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.591184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 323/638] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:31.592919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.593210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.593492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.611065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 316/639] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:31.616258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.616542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:31.617747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:31.684159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.703096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 324/640] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:31.704071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.728679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7fde-a4ed-43ef-8ca9-7e14a9cda75d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.736257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.768833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.769857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.770343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.770830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.772501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:31.773028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.774660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.785203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 317/641] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:31.786358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.819427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3cb7-6201-4b39-8dfb-5e2112f1a83a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.865593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.866406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.866694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.866972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.877558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.879726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:31.899252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:31.900692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:31.901610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:31.902620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 325/642] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:31.903002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:31.913676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216931-e868-472d-95f9-cc1bba650e69 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:31.945046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:31.961835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:31.962916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:31.963727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:31.964215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:31.977539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:31.979546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:31.999054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:32.000300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:32.001323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:32.001323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:32.001323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:32.001323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:32.007687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 318/643] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:32.008690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.020200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.034521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b8002-f7c2-42f9-94c7-23090a0e82e9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.075589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.077906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.081344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.081803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.096560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:32.104954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:32.106082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:32.107205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:32.113015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 326/644] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:32.113015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.141232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df595-69da-4caf-b615-8747a4a3dea3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.182639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.183539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.183732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.184007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.196383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.198511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:32.219576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:32.220496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:32.221644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:32.221644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:32.221644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:32.221644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:32.226339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 319/645] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:32.226339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.251267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d52cd-946b-4e54-b074-79f6ec0e177c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.262572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.295701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.296647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.297078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.297592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.298999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:32.299549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.301179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.331436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 327/646] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:32.331436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.345711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.357901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de95440-9c72-4f90-9139-ce34fbdbd99b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.404721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.405481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.405833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.406581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.407554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:32.408026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.409556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.431417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 320/647] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:32.431417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.451241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95feb5-ac73-4a1e-a297-4e85ba731b8d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.488275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.489005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.489294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.489571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.490326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:32.490637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.494499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.502645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 328/648] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:32.508330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.543425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.554957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c887-512c-4478-bfe3-6024b4adb835 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.600106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.600608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.600947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.601235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.601506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.602235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:32.602553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.603949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.624065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 321/649] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:32.624065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.644158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21ff9-6d85-488c-a6e9-61baf8e121f0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.689091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.689754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.690210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.690491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.759571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d7787-ff8b-4a16-915e-a2eb2c57421f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:32.776117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.777882 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.809135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:32.810178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:32.810964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:32.811249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:32.819209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:32.822046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:32.837749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:32.838685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:32.840216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:32.840847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 322/650] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:32.842143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.858350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.875534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:32.916617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 329/651] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:32.917542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:32.993275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007872b-9895-406a-9f6e-5a73ce765e13 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.038765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.039720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.040005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.040279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.053905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.055614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d18f1-669e-475b-a509-5b373fab8684 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.056828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:33.078594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:33.079617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:33.080579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:33.080579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:33.080579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:33.080579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:33.080579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 323/652] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:33.081734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.117192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.118004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.118285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.118562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.127378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.128877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:33.149162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:33.150234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 330/653] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:33.151169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.161522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:33.191358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:33.218584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0d283-f4a6-48c0-82c1-41ca65a29179 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.264336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.265115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.265508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.265873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.266784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:33.268082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.269643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.279363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91c2f8-80d3-41eb-a09a-fb2e618579f1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.281843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 324/654] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:33.282896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.326395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.327188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.327539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.327820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.341090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.342671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:33.364551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:33.365471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:33.366319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:33.366319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:33.366319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:33.366319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:33.370830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 331/655] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:33.371926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.410605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511efd-1932-4da0-bce0-26c7867620b3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.439231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:33.457982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.458640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.458923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.459200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.460054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:33.460368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.462160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.469473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:33.476672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 325/656] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:33.477776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.496371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756185-03a6-4f00-bd19-973ab2c2892f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.535608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.536280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.536619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.536835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.537710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:33.538054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.539535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.561688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 332/657] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:33.562527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.598946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70f588-1d94-4ab8-b563-d30c32f5124c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.638748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.639420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.639867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.640145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.640978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=a758c6680078465d8d65ffd105594530) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:33.641292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.642757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6235-5e13-4698-a4b4-ac68e3dff4cc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.648871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 326/658] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/role_assignments?user.id=a758c6680078465d8d65ffd105594530&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:33.650121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5bba-b8ec-4ead-bfbe-4799f8f70fc0 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.650685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5bba-b8ec-4ead-bfbe-4799f8f70fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.650969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5bba-b8ec-4ead-bfbe-4799f8f70fc0 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.656800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 327/659] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:33.656800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5bba-b8ec-4ead-bfbe-4799f8f70fc0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.677680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e422bc-352d-42a4-94a4-433bd31e723c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.713884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:33.720348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.722115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.722546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.722832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.723658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:33.723974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.725421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.737106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:33.745611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 333/660] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:33.745611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:33.795469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5bba-b8ec-4ead-bfbe-4799f8f70fc0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.848415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.849665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.850167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.850452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.862225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:33.863929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d6a6df32-ef95-4c52-a7f1-db21e34ab859 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:33.885579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:33.886713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:30:33.887720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:33.889299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 328/661] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:33.891349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.891878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.892326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:33.894250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3680f-c02d-4c6a-a336-c22080cd3ba3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:33.916286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:33.917504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:33.938627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:33.939413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:33.939774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:33.940379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.013383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 329/662] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:34.015613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.051000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.052408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.055176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.066421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.152042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a490-e853-4649-9499-8045d1a332e6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.194218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 334/663] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:34.194218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.201439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.202450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.202896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.203435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.212876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.214323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:34.231433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:34.233149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:34.234252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:34.241025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 330/664] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:34.242246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.326812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.330507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae73ac6-6d92-4302-bb58-f20576e7aeea None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.356426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.366087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a899556-0dab-4c8e-8ba4-41cfd234cd03 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.381281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.382628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.382916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.383189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.384078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:34.384390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.385898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.409328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 335/665] 10.222.0.57 () {56 vars in 1139 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:34.410443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.431628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.432824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.433115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.433392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.448218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:34.457999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:34.458927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:34.460130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:34.461173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 331/666] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:34.461173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.545453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e944b-19f3-411a-879a-8705eb290372 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.589594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf503c-6ff6-4cbb-b354-0de9e73bbd01 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.592292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.594031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.594316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.594590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.609146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.610597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:34.632465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:34.633373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:34.634237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:34.634237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:34.634237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:34.634237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:34.636163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.637019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.637491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.638019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.638251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 336/667] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:34.639717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.640044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:34.642227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.645171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.657539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.661434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 332/668] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:34.662718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.684807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.782583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594bc8-90bb-455e-939b-4b91cb48e37d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.788276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a59f4-d000-434c-8a1b-d08eecec6393 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:34.826930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.827617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.827903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.828513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.829498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:34.830472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:34.830762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:34.831093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:34.831893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:34.832242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.833627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.847537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 333/669] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:34.848514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:34.925703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:34.928200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:34.943860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.952074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:34.982121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8f2de-8738-448b-80bf-0dc9e37d0b88 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.035859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.037264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.037831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.038116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.038852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:35.039161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.040839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.059522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 334/670] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:35.061253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.069212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 337/671] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:35.069212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.186311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62bd26-ef3f-47cd-9840-029990cfa431 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.200864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049f78a-13bb-4e8b-810f-79bb0d52b33f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.214128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:35.232904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.233707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.234137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.234410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.235542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=17968a13a13d4ad49956f1276256e8c6) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:35.236073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.237845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.242564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:35.246514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.247319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.247635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.248437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.251562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 335/672] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/role_assignments?user.id=17968a13a13d4ad49956f1276256e8c6&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:35.253676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.280479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.281995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:35.332113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:35.333112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:35.333976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:35.333976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:35.333976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:35.333976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:35.336393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 338/673] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:35.337299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.473070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a215ed-2c33-468c-8c02-25a3463a4d69 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.534786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.535996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.536482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.536923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3bc1-29e8-4edc-a929-de6a5ad33abe None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.537189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.548770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.551146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:35.571735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:35.572668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:35.573534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 336/674] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:35.574543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.583798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.584910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.585820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.586302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.603083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.605901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:35.635372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:35.636313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:35.637182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:35.637182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:35.637182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:35.637182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:35.646530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 339/675] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:35.650528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.661003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:35.680395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:35.743749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8383a8-b959-4525-95f7-969ae52f0069 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.797991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.798660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.798945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.799230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.800001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:35.800307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.801855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.822119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 337/676] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:35.822119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.851122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172570-86c8-4b22-9062-d3f511271287 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.902973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:35.903692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.904779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.905059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.906114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:35.906429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:35.908497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde063c8-455e-4025-aeb1-bf91015eaba7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:35.930037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 340/677] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:35.930037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8012-1773-48e3-8514-1bda706888ac None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:35.930037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8012-1773-48e3-8514-1bda706888ac None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:35.930037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8012-1773-48e3-8514-1bda706888ac None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:35.930037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 341/678] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:35.930037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8012-1773-48e3-8514-1bda706888ac None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:35.958551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01eaab-a2da-4db9-8ccd-2aa159baa0ea None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:35.985538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:36.010647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.011433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.011743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.012022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.012768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:36.013060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.014510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3976e5-2dee-4459-8619-fab6e7faeaa9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.034219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:36.034720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 338/679] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:36.035885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.036361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.036451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.061272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:36.062560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:36.068339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8012-1773-48e3-8514-1bda706888ac None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.113708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.114623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.114972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.115316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.130946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.132648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:36.149550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:36.150541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:36.151504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:36.155749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 342/680] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:36.156623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.165245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 339/681] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:36.165245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.302419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb515d5-28a7-442f-adb9-739ef70b0570 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.315621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:36.316940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128557-e959-4128-b0e6-4a158fa99e92 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.346532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.347293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.347612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.347891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.356937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.357233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.357889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.358170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.358420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.358531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.359261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=0a6925d9c52e4bf9ab900755b8aac7fb) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:36.359599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.361007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.363103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:36.373581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:36.374530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:36.375439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:36.377826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 343/682] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/role_assignments?user.id=0a6925d9c52e4bf9ab900755b8aac7fb&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:36.378989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.379886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 340/683] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:36.380841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.515417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852f28-d2fe-4f44-a399-8d251395fdf0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.562412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.563159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.567415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.567415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.580866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.582993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:36.604868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:36.605791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:36.606704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:36.606704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:36.606704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:36.606704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:36.606704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 341/684] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:36.612303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.639558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415263a-f282-49ed-9f3e-3a530d5e6dea None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.653630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:36.696036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.696728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.697009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.697267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.698119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:36.698425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.701553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.740035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 344/685] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:36.740035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.787670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4de62-4c05-4104-96a8-868a8be5a5f7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.820583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:36.832045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.832912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.833324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.833749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.836851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:36.838684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.840481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.866030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 342/686] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:36.867686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.877819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7533-74b2-4e32-86f5-da548290282b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:36.925615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:36.926505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:36.926757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:36.927035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:36.927801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:36.928110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:36.929616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:36.951406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 345/687] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:36.953317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:36.992222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:37.032818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679dd79-7010-4aa5-9034-5534687e19df None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:37.120048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5be5d8-9d46-42f2-94d1-4ac6b1672488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:37.121450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5be5d8-9d46-42f2-94d1-4ac6b1672488 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:37.121955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5be5d8-9d46-42f2-94d1-4ac6b1672488 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:37.122435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5be5d8-9d46-42f2-94d1-4ac6b1672488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:37.168518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cc7e-3ba7-4203-906a-32445b329203 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:37.203729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:37.241949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:37.244225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:37.245293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:37.247185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:37.248940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=1d85eeb2282b4f9ca9f357c0e0948de0) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:37.249644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:37.252313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:37.266642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5be5d8-9d46-42f2-94d1-4ac6b1672488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:37.267455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 346/688] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/role_assignments?user.id=1d85eeb2282b4f9ca9f357c0e0948de0&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:37.268483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:37.269772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5be5d8-9d46-42f2-94d1-4ac6b1672488 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:37.454572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:37.480726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea845b-ca6f-44c4-9681-54beef12790e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:37.502412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 343/689] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:37.503800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c843-504d-4277-a22f-5fc7fcd133d5 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:37.504092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c843-504d-4277-a22f-5fc7fcd133d5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:37.504360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c843-504d-4277-a22f-5fc7fcd133d5 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:37.509721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 344/690] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:37.511905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:37.511905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:37.511905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:37.537853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:37.539483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:37.560152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:37.560429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:37.560720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:37.560989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:37.561691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:37.563121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:37.594248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 347/691] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:30:37 2022] POST /identity/v3/users => generated 254 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:37.594248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:37.678868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:37.740714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 345/692] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:37.806635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:37.860160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80845def-164d-4c7c-b19f-43749f29e8b0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:37.898354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:37.899172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:37.902676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:37.902676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:37.914825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:37.916411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:37.935857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:37.936799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:37.937672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:37.937672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:37.937672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:37.937672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:37.937672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 348/693] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:37.942384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:38.042129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefeb854-7419-4ee8-b87d-9a25964ea084 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:38.072740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:38.117527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:38.119100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:38.119100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:38.119100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:38.123914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:38.140205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:38.147937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:38.148825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:38.149631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:38.150911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 346/694] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:38.156427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292db46-f879-45ac-ba1b-c17f12d6d1cb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:38.159558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:38.215221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:38.215915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:38.216200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:38.216501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:38.217283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:38.217595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:38.219000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:38.244710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 349/695] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:38.249119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:38.402214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c5c1-af8a-41cc-b091-f4c7a8fd25eb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:38.492186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:38.492789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:38.493073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:38.493352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:38.494116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:38.494423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:38.495831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:38.513521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d406-3b67-411e-a4c2-315f7bd4b7b6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:38.519052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 347/696] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:38.529243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:38.635559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:38.655498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:38.655498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:38.655498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:38.655498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:38.699452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:38.699452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:38.742867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:38.744060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:38.744954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:38.754733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 350/697] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:38.756741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:38.777166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12452eb1-75ee-4ecb-a817-a3bcb2414557 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:38.781624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:38.846772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:38.847906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:38.848393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:38.848863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:38.870923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:38.873502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:38.903410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:38.904908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:38.905835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:38.905835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:38.905835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:38.905835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:38.908142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 348/698] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:38.914339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:38.962427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cb479-8c6b-4247-afb3-255e4f217816 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.020322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.020999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.021437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.021723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.022533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:39.022848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.024319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.048924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 351/699] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:39.054377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.073958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:39.094804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205d46-d365-4457-9384-a62cf03770c6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.136034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.136753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.137048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.137330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.138063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:39.138896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.140334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b4790-a3ad-439a-91ba-8a7894a0a1c4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.141887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:39.153034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 349/700] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:39.154934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b6166-370d-4a8c-805f-5a4db06f608b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.155228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b6166-370d-4a8c-805f-5a4db06f608b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.159826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b6166-370d-4a8c-805f-5a4db06f608b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.161262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 350/701] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:39.161991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b6166-370d-4a8c-805f-5a4db06f608b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.184630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb997570-743d-44f4-8d07-7c2b4ae0f0e4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.235947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.237084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.237476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.237855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.239511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6da2eb51566940d7bee3a44f019e06ba) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:39.239961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.242063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ecc14-ade4-44fc-80a4-ac6c302e1e6c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.250866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 352/702] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/role_assignments?user.id=6da2eb51566940d7bee3a44f019e06ba&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:39.252732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.253349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.253712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.275327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:39.276809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:39.284881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b6166-370d-4a8c-805f-5a4db06f608b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.336366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.337193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.337500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.337774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.350254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.351761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.360966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 353/703] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:39.374778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:39.375801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:39.376823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:39.380818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 351/704] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:39.382276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.396813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.406971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:39.503692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:39.543854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d14a02-683d-4073-9ad2-99352c8b4805 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.551582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc44c3-1a7b-497f-a490-1fc7db0927a6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.588972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.590046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.590325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.590594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.591463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.593411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.597839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.598697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.599126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.599428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.600283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:39.600594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.602012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:39.609634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:39.610568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:39.611427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:39.615502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 352/705] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:39.619459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.620753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 354/706] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:39.635842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.718014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:39.768253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589f7b5-402e-4b96-a82a-57217696c09c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.793646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1ba1-6eaa-4ceb-8884-f86a6ef9a65e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:39.812708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.814219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.814515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.814795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.816612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:39.816612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.817563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8f288-d571-46e7-927c-a32f8f45efda None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:39.825081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:39.827296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 353/707] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:39.829081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904528e3-3415-46df-a95f-d8cf7949d054 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.829278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904528e3-3415-46df-a95f-d8cf7949d054 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.829515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904528e3-3415-46df-a95f-d8cf7949d054 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.835024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 354/708] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:39.835024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904528e3-3415-46df-a95f-d8cf7949d054 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:39.859251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:39.860203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:39.860631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:39.861047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:39.965575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:39.968551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.012131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904528e3-3415-46df-a95f-d8cf7949d054 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:40.075172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:40.076682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.077111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.077600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.078327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:40.078634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:40.080057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7441-48bb-4fb0-9f4e-a85a65c4e4b9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.082372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:40.094942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 355/709] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:40.103626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.103626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.103626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.122605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:40.124230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:40.225200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 355/710] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:30:40.229582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:40.264260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:40.266136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 356/711] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:40.293452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:40.402760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7aa2-9a06-4934-8416-cbd96261a8fd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:40.423565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfaf1e-0381-4a8b-87bf-b570c0f4a441 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:40.446189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:40.447127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.447237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:40.447771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.448019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.458030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:40.458832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.459117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.459514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] PATH_INFO: `/v3/services/network` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.460178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:40.461554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.461671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:40.463028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-7d10425d-3f0c-4295-8c8f-476bb672582d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:40.474098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:40.475068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:40.475926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 357/712] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:40.477283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8615608-002c-41b8-ad83-b8606f41284a None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.477283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8615608-002c-41b8-ad83-b8606f41284a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.477580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8615608-002c-41b8-ad83-b8606f41284a None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.482820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 358/713] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-804eb0df-dd73-41ae-adf2-98c356b8bbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:40.486045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:40.486912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:40.487893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:40.487893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:40.487893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:40.487893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:40.488117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8615608-002c-41b8-ad83-b8606f41284a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:40.490949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 356/714] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:40.492473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.492957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.493447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.516042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:40.517242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:40.617882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8615608-002c-41b8-ad83-b8606f41284a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:40.656415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:40.657327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.657756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.658174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.659047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] RBAC: Adding query filter params (name=network) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:40.659544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:40.661102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.671985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 359/715] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:40.673205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:40.723782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 357/716] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:40.724767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:40.727256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:40.738767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:40.796374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b504427-2cd2-4cbb-b790-c1d2b24d964e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:40.835610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:40.836277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.836566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.836848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.837690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:40.838008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:40.839531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.853537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 360/717] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:40.854529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:40.864373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc9790-1624-4c9a-ae50-7bbfcfb7407d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:40.906917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:40.907531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:40.908185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:40.908464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:40.909449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] RBAC: Adding query filter params (type=network) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:40.909755 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:40.911573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:40.923594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 358/718] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:40.924554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.018691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0109-4ce5-4afe-9813-46efd458f10c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.052014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:41.067421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:41.093739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.094558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.094845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.095122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.113125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:41.122516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:41.124037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:41.125322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 361/719] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:41.129868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02571f32-1f64-4af2-9f85-b6a651dc9e0d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.133380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.170359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.171086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.171375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.171688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.180846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:41.182365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:41.198650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:41.199585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:41.200464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:41.202001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 359/720] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:41.207607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.277029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908a97-a66b-40bb-b2b1-4f0604a240ce None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.344850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.345526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.345804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.346072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.347095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:41.347410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:41.348795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:41.362627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 362/721] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:41.368532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.394868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312ea8-d6ad-48b1-97cf-a4349225a4c1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.415654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:41.469075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:41.484597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a452-6d60-46ea-8f5c-03d76227a639 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.500633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.501311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.501595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.501872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.502672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:41.502980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:41.504464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:41.520812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.521617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.521906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.522244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.533981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:41.535592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:41.537771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 360/722] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:41.543506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:41.554728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:41.555581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:41.556447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:41.556447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:41.556447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:41.556447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:41.556447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 363/723] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:41.561926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.732972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:41.734291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572abf4-99df-4e95-9c1b-9d4741027720 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.755080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec20c2e-e09a-4cc0-a2f1-fcc6d280b6b3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:41.803081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.803775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.804050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.804323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.805157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=17968a13a13d4ad49956f1276256e8c6) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:41.805463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:41.806901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735177c8-04e4-43e7-a24b-34c8759b763f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:41.819339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 361/724] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:41 2022] GET /identity/v3/role_assignments?user.id=17968a13a13d4ad49956f1276256e8c6&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:41.824970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:41.825650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.826520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.826800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.827550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:41.827856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:41.829293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:41.840880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a82b-60c5-4631-993a-37833a132407 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.841614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a82b-60c5-4631-993a-37833a132407 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.842111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a82b-60c5-4631-993a-37833a132407 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.844115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 362/725] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:41.850134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:41.850719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:41.850925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 364/726] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:41.851421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:41.856338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:41.876096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:41.878118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:41.970711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.013328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 363/727] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:42.033409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e19b5-12bc-4636-944b-9f73e3baa395 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.052368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.086472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.087286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.087592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.087868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.103199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:42.108237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:42.135266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:42.136287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:42.137204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:42.147677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 365/728] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:30:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:42.153557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.167963 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.257710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7227d-e533-4113-9c5d-f424a7890e2f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.303092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3be2d-7135-4a50-b463-ee2e9eaf0df3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.335189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.336930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.337479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.337988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.356059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:42.364477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:42.365621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:42.366686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:42.369665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 364/729] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:42.375295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.394828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.396660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.397670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.398387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.400765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:42.401267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:42.403677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5de36e-84bb-41b9-adfd-be3d924749aa None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:42.438266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 366/730] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:42.440035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e23a-86f4-45e7-bd2e-f565cd75ab02 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.440517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e23a-86f4-45e7-bd2e-f565cd75ab02 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.440964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e23a-86f4-45e7-bd2e-f565cd75ab02 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.442612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 367/731] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:42.443479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e23a-86f4-45e7-bd2e-f565cd75ab02 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.447563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.509800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842997d-28bd-440c-b3cb-785946006c69 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.515754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.546135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.547180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.547686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.548158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.549109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:42.549632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:42.551177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70312-6603-4403-8bbf-b8538014c169 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:42.553206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e23a-86f4-45e7-bd2e-f565cd75ab02 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.560729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 365/732] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:42.567028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.567434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.567810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.586946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:42.588432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:42.590848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.592098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.592445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.592725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.665404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:42.666864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:42.667716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 366/733] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:42.668689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.717625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.737669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.774822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 368/734] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:30:42.775697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.793780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ccf6-0fbf-452a-b522-0fbee9d77227 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.830414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.831566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.832064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.832647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.844520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:42.846222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:42.865773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:42.866682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:42.867606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:42.867606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:42.867606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:42.867606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:42.874305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 367/735] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:42.877353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.881927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84378ba-1bd5-4844-84b6-1beb4cd6cbcb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:42.924240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:42.924721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:42.925047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:42.925326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:42.926072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:42.927450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:42.951879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 369/736] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:30:42 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:42.951879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:42.983799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:42.995410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:43.022060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5537e-6947-49c4-b452-985978dac1b9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.086781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15464a2-efb8-458b-953b-0a400abbcb4f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.093208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.094341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.094837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.095305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.115815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.117666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.126146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.126823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.135531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.135531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.135531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:43.135531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.135531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.144080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 370/737] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:43.152295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:43.153165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:43.154658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:43.154658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:43.154658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:43.154658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:43.156989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 368/738] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:43.158538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.162372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.291424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:43.309072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375459-4756-4c12-8aeb-bdce813e72af None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.318488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6cee-b4b8-4dc7-91db-ffddffda8645 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.348077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.348754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.348975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.349252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.349984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:43.350291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.351821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f99e5-65f2-4adf-a1f8-c78db078ad94 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.354302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:43.358307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.359410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.360704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.361184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.366004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 369/739] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:43.367419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49c7e-25a9-4587-bcc7-617f6ef7c233 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.367734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49c7e-25a9-4587-bcc7-617f6ef7c233 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.368011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49c7e-25a9-4587-bcc7-617f6ef7c233 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.369521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 370/740] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:43.371598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.373817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.376735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.377488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.377488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:43.390650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:43.391689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:43.392632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 371/741] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:43.393211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.399226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:43.400742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:43.499521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 371/742] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:30:43.499521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.520700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e6028-65b3-4e4c-b03f-c3749e61cf71 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.568434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.569590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.570050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.570521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.579183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.581070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:43.597378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:43.598378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:43.599289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:43.606332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 372/743] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:43.608097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.612302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:43.628265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98691c94-4ecc-48a1-a697-22870312da3f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.656027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:43.665541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.666222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.666504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.666778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.667662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:43.667970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.669404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.692543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 372/744] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:43.693417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.724711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262a06-e4e6-442d-9725-e29db3d903ac None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.763042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.764178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.764757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.765231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.766196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.768159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.795416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 373/745] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:30:43 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:43.795416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.822956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b55cb5-4e77-4ad7-80a9-d1469093980d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:43.911148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:43.911756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:43.912037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:43.912308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:43.913102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:43.913408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:43.914849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:43.932616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:43.943326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 373/746] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:43.945724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:43.989474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3c5c7-fb3f-48ce-b8dd-9d55e2d5c2b4 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:44.019439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:44.030337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:44.031048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.031335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.031639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.096919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aa66b-0aee-4e89-b7e3-beee774b9993 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:44.116686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:44.118721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:44.132971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:44.133626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.133954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.134230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.135058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=ffab8172e35f4150ac7303eeceb05738) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:44.135367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:44.136809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91190e2a-a544-4b81-99ec-ebba0e36fe6a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:44.143570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 374/747] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/role_assignments?user.id=ffab8172e35f4150ac7303eeceb05738&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:44.144822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95551a-5ddf-44c2-aff0-e4a096c3bd48 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.145107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95551a-5ddf-44c2-aff0-e4a096c3bd48 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.145380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95551a-5ddf-44c2-aff0-e4a096c3bd48 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.146858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 375/748] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:44.152983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.153300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.153540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.173375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:44.174573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:44.205989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:44.250683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 374/749] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:30:44.256280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:44.294430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 376/750] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:44.329186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:44.423087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:44.493485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a791bd-d559-4cef-b86c-2035922a1ce7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:44.519876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd72a-5793-48ad-a3c2-f97f6abeef71 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:44.532788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:44.533583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.533867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.534150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.553702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:44.555369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:44.574752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:44.575721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:44.576965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:44.576965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:44.576965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:44.576965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:44.579307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 375/751] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:44.584873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:44.615779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:44.616082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:44.616898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.617186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.617452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.668044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:44.676501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:44.677443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:44.678252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:44.687847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 377/752] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:44.693293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:44.695245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40f9b6-edf7-466c-9e6d-ae3e6dd4bc4e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:44.733946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:44.735200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.735697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.736116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.736982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:44.737432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:44.738978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:44.752036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 376/753] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:44.757912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:44.847782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:44.867958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c70f-9c86-4053-ad43-7644a7485e69 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:44.907317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:44.908785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:44.909241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:44.909683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:44.917577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:44.919181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:44.936213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:44.937085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:44.937945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:44.940895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 377/754] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:44.946421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.016500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:45.028186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05874f-d3cf-4cdf-9377-a13366ad2f5b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.068525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e9798-9641-4117-aad5-78885be9f3b0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.117620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.118303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.118590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.118869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.119653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:45.119966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.121342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.132003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.132670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.132958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.133235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.134042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:45.134355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.135839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.142099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 378/755] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:45.151760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:45.153349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.168212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 378/756] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:45.175208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.293242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f6258-a19a-4cc0-a663-fc7c235a3a94 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.311663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913425-8450-44ed-ba60-3ba68861415c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.329808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.330661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.330948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.331223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.343122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.344601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.350954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.351647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.351937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.352219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.353050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6da2eb51566940d7bee3a44f019e06ba) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:45.353364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.354782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6816b-e7f2-4a0a-b33f-ccff2a6615f1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.360840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 379/757] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/role_assignments?user.id=6da2eb51566940d7bee3a44f019e06ba&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:45.362135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97f74-525f-4c6a-8fab-dce28fbfd1bc None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.362428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97f74-525f-4c6a-8fab-dce28fbfd1bc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.362709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97f74-525f-4c6a-8fab-dce28fbfd1bc None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:45.363018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:45.363877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:45.364754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:45.364754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:45.364754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:45.364754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:45.364977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 380/758] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:45.368233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 379/759] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:45.373272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.373567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.373836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.376507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.395129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:45.418817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:45.421177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:45.499187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:45.527000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 381/760] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:45.542645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce738-d8e5-44ed-bc54-80e057b54959 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.555323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.582959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.583742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.584041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.584321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.585106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:45.585418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.586798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.600412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 380/761] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:45.605740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.728406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc5bf3-db23-4041-9d30-b79796f240a4 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.742999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:45.793153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.793976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.794259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.794534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.795336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.796849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.798601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704ae1b-57cd-48c4-8ad9-b4669da2b1d7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:45.817944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:45.819039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:45.820541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 382/762] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:45.840767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:45.851960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:45.852878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:45.853165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:45.853440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:45.866255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:45.867814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:45.905068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:45.907344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:45.909604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:45.911809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:45.911959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 381/763] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:45.917781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.002739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c39e6-b152-40fb-af56-651ce4cd31e9 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.043374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821061c0-1362-49dd-a728-17d5cbc1c8cc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.068080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.068770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.069067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.069346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.070062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:46.070469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.071284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.072871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.078972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 383/764] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:46.085694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.088884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.089574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.089858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.090134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.090991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:46.091301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.093347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.131164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 382/765] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:30:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:46.137362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.223422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3817cd-0906-467e-88b7-2cc3f3a07d80 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.241572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.247015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2a3c9-70d3-494f-88c1-093159000ff6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.260170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.260927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.261366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.261719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.262603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:46.262980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.265439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20679-3b64-45f9-87bf-e774d32072cd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.270964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 384/766] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:46.272469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20075ee2-de2d-41ee-9cd6-a95a4a23424d None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.272685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20075ee2-de2d-41ee-9cd6-a95a4a23424d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.273029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20075ee2-de2d-41ee-9cd6-a95a4a23424d None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.278681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 385/767] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:46.280245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.280688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.281026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.289506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.290212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.290495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.290768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.300683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:46.301557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.302102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:46.303018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:46.321698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:46.323479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:46.325309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:46.325309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:46.325309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:46.325309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:46.325309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 383/768] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:46.325309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.365450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.387584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 386/769] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:46.389135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.434356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795e67-1e1a-4e61-9fa0-9345d6cc1cfa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.470780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.471844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.472208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.472555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.473446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] RBAC: Adding query filter params (interface=public, service_id=93d3314b61d948ea914d5b95a7ae2555, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:46.473816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.475263 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.487682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 384/770] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/endpoints?service_id=93d3314b61d948ea914d5b95a7ae2555&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:46.488703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.508887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383e9a-e77c-433b-ad28-fd7f13ee7deb None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.524307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.550225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.552559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.552904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.553238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.554232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:46.554697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.556197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.569662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 387/771] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:46.570682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.597041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfbf17-895f-4a6e-88bb-485f545f0b99 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.598712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.633846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.634880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.635163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.635473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] PATH_INFO: `/v3/services/network` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.636137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.637504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:46.651110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:46.653641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:46.654702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 385/772] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:46.655763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.690300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049a4a-14f3-4a1f-b3c9-b4d6a7aac8e9 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.729723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710440f-c511-4535-b2fc-3850e145c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.730386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710440f-c511-4535-b2fc-3850e145c790 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.730667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710440f-c511-4535-b2fc-3850e145c790 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.730937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710440f-c511-4535-b2fc-3850e145c790 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.731649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710440f-c511-4535-b2fc-3850e145c790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.733567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710440f-c511-4535-b2fc-3850e145c790 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.738775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 388/773] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:46.740011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b157f-de33-4f4b-914f-c00d5d843f1f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.740293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b157f-de33-4f4b-914f-c00d5d843f1f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.740568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b157f-de33-4f4b-914f-c00d5d843f1f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.741986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 389/774] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:46.742503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b157f-de33-4f4b-914f-c00d5d843f1f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.772631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb7f3-b401-40ce-b216-6c7e38b7222f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.796797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.814032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.814841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.815119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.815416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.823118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.824624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-cf735aad-a5a9-4f5c-a65a-4cfac9de2f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:46.840183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:46.841154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:46.842349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 386/775] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:46.843131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.843380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.843675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.863539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:46.864797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:46.884043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b157f-de33-4f4b-914f-c00d5d843f1f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:46.888216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:46.934300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:46.935931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:46.936378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:46.936657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:46.937372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] RBAC: Adding query filter params (name=network) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:46.937684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:46.939028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:46.944612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 390/776] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:46.945203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:46.947968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 387/777] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:46.951606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.052692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:47.056057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6b4e-984e-475d-a142-88629aac390e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.072054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7870-a22e-4876-8072-60e08d681061 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.091430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.092921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.093414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.093896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.094886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:47.095450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.097351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.111186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.111978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.112238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 391/778] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:47.113394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.117066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.117305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.118902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:47.118902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.119883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.130137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 388/779] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:30:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:47.130137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.158854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:47.252890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbf1a-7dc1-4897-86e1-ef6abd4fff7b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.260676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895c1f-0b09-47ad-ab2d-0b40045274a2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.299659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.300633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.301018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.301388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.304661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.305725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.306158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.306612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/17968a13a13d4ad49956f1276256e8c6/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.309437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=17968a13a13d4ad49956f1276256e8c6, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.311419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.312803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:47.321660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:47.322992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:47.324238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:47.328040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 392/780] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:47.328909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.343417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 389/781] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:47 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/17968a13a13d4ad49956f1276256e8c6/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:47.345051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.354259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:47.442892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61562ab2-55f7-4380-a820-576e2a4d8276 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.484490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.485588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.485588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.485850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.486677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] RBAC: Adding query filter params (interface=public, service_id=36f65a87dd794298b74dbd1fddc5c13b, region_id=RegionOne) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:47.487001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.488583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.491485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:47.506035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 393/782] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/endpoints?service_id=36f65a87dd794298b74dbd1fddc5c13b&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:47.507814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.532333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65203d51-d61b-4d76-ba28-c93287572f19 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.600400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.601052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.601052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.601203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.601885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:47.602198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.603600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.618827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 390/783] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:47.620618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.628593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:47.648469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f5c71-e3ef-4473-aeee-4a928b091395 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.688854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cce23-a7a4-4e62-8afc-fe7c0f5d8bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.689520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cce23-a7a4-4e62-8afc-fe7c0f5d8bdc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.689805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cce23-a7a4-4e62-8afc-fe7c0f5d8bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.690223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cce23-a7a4-4e62-8afc-fe7c0f5d8bdc None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.690868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cce23-a7a4-4e62-8afc-fe7c0f5d8bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.692555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cce23-a7a4-4e62-8afc-fe7c0f5d8bdc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.703482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 394/784] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:47.732089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0b7d-3fe6-45de-8565-cfd64d098864 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.732434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0b7d-3fe6-45de-8565-cfd64d098864 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.732675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0b7d-3fe6-45de-8565-cfd64d098864 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.734384 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 395/785] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:47.741405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.741796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.742177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.762255 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:47.762577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a03803-0fb1-441e-a9fe-fecc2ba842fd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:47.764369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:47.806583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:47.807893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:47.808317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:47.808969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:47.826672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:47.831929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:47.841184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:47.874050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:47.874998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:47.875901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:47.875901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:47.875901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:47.875901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:47.875901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 391/786] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:47.886678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:47.915400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 396/787] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:47.941076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.028461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9024c9-1f6e-46c6-83ed-312516bb45ae None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.050758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:48.078787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eb9b-550e-4274-9ac2-45d9ac7fea55 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.081543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.082483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.082969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.083487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.084422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:48.084944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.086522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.107911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 392/788] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:48.109172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.132171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.132985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.133266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.133540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.148249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:48.156030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:48.156927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:48.157738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 397/789] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:48.174582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.223519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:48.266123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316b2d-6c3f-420b-9ac5-94e4344c9387 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.313908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.314658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.314939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.315254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.320212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b506aa-5237-430b-9cf0-94ec4855a663 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.324580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.326074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.356565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.358149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.358637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:48.358904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:48.359848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:48.360817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 393/790] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:48.362206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.363224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:48.363766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.365435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.368306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.371826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:48.377330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 398/791] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:48.386976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.487932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d478ab5-8c42-4b05-ac95-2030bff12dd7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.493205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5480cac-ba77-4d5a-836d-d103041fc9d7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:48.536696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.537382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.537668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.537945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.538318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.538802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:48.539113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.540131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.540595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.541052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.541713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.557787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.560127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.573511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 394/792] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:48.579827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:48.580887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:48.581955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:48.581955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:48.581955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:48.581955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:48.582744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.587416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 399/793] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:48.600016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.663768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:48.708590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2867-b43e-4379-93b3-21d9d1a34fd6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.744887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.745711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.746102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.746479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.747315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:48.747776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.749341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.761919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 400/794] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:48.772372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.801258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73ef1-9c11-4203-b2c8-82f307cc7701 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.838309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:48.840077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:48.840728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:48.842691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:48.865763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:48.867666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:48.893940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:48.894870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:48.895770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:48.895770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:48.895770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:48.895770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:48.898098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 395/795] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:48.904971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:48.943862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:48.972282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d7e4-33f4-4180-b6a2-b1c1d682d391 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:48.985608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.007308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.008141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.008433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.008715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.023536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.023536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:49.034476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:49.035372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:49.036311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 401/796] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:49.042718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.099548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101d949-c44a-427e-98e5-38a05ba99668 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.134691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.135376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.135690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.135971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.136731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:49.137041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.139015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d1416-6193-4dbb-86ca-9b6ffd67ed89 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.158407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 396/797] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:49.159924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609ba0-cd3c-49e2-b17d-d1a21bb1b65f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.160220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609ba0-cd3c-49e2-b17d-d1a21bb1b65f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.160503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609ba0-cd3c-49e2-b17d-d1a21bb1b65f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.162639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 397/798] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:49.168640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609ba0-cd3c-49e2-b17d-d1a21bb1b65f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.175105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5997c-a39d-47fc-bd06-e6286013de4f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.210671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.211416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.211738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.212020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.213053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:49.213372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.214858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d2d9-5a10-4dfb-a6b2-17d90b431362 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.233868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 402/799] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:49.235296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.235646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.235929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.254448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:49.255672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:49.280286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.287782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.291975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609ba0-cd3c-49e2-b17d-d1a21bb1b65f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.325568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 403/800] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:49.327118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.329672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.330666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.331072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.331553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.339147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.340904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:49.356365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:49.357474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:49.358572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:49.360453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 398/801] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:49.372430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.430108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce03ae0-20e5-4410-8804-995f20f9474d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.470265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.471065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.471349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.471659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.482675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.484169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.485543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f1b4-0301-47ec-98c2-6efbe2d2d5ae None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:49.502744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:49.503863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:49.504927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:49.504927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:49.504927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:49.504927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:49.504927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 404/802] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:49.505207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.521009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.533767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.534908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.535603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.536107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.537111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:49.537732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.539558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.556747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 399/803] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:49.557996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.562851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.618403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a123f-55e3-4de7-9bcc-cc1aa57dc67b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.660708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.661807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.662242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.662664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.663619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.665231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.670877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197fc41-01aa-4467-99f1-7380b9b1d497 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:49.679630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:49.680577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:30:49.681410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:49.684609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 405/804] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:49.686273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.710179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.710988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.711344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.711714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.712519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:49.712899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.714497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.732897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 400/805] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:49.733918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.773704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.799443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ae38-d155-4d90-a198-185e3fd78701 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.804083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:49.845811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.846454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528878-d444-4cb9-a321-c2b348e009af None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:49.847542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.848009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.848555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/ffab8172e35f4150ac7303eeceb05738/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.868062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=ffab8172e35f4150ac7303eeceb05738, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.870076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.884658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:49.885472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:49.885764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:49.886036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:49.886794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:49.887110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:49.889139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:49.889639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 406/806] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:49 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/ffab8172e35f4150ac7303eeceb05738/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:49.891017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:49.894694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 401/807] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:49.899974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.015915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4908-2ffe-4165-8240-4f8ceef189e0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.017750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff64f-bb38-4f73-8169-940f5d898acd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.053823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:50.055790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:50.071339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.072167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.072453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.072727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.073498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:50.073807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.074760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.075306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178dd5-e6b4-427e-9d04-b602378af127 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.076501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.076940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.077383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.082530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 402/808] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:50.083906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f8d8b-cf96-4d21-ae1e-e6abf4598741 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.084194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f8d8b-cf96-4d21-ae1e-e6abf4598741 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.084469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f8d8b-cf96-4d21-ae1e-e6abf4598741 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.086473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.088245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.089955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 403/809] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:50.090884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f8d8b-cf96-4d21-ae1e-e6abf4598741 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-5515d82d-2278-4d33-bb75-d30721c9454a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:50.105472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:50.106618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:50.107690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:50.109856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 407/810] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:50.111551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.112061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.112524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.137377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:50.139196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:50.208873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f8d8b-cf96-4d21-ae1e-e6abf4598741 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.211892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 408/811] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:50.212774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.245052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cafd2-2f7a-4023-b2fd-6ec6542c5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.245712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cafd2-2f7a-4023-b2fd-6ec6542c5f5b None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.246003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cafd2-2f7a-4023-b2fd-6ec6542c5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.246267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cafd2-2f7a-4023-b2fd-6ec6542c5f5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.247003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cafd2-2f7a-4023-b2fd-6ec6542c5f5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.248938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cafd2-2f7a-4023-b2fd-6ec6542c5f5b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.273007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 404/812] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:30:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:50.281234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2770db-17c9-4df5-b684-c399327a465a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.282683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2770db-17c9-4df5-b684-c399327a465a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.283270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2770db-17c9-4df5-b684-c399327a465a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.290278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 405/813] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:50.290278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2770db-17c9-4df5-b684-c399327a465a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.351929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:50.363529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04e5c-0554-4439-a871-8bc58cf286ea None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.389560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:50.423726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.424649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.425368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.425794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.426864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:50.427141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2770db-17c9-4df5-b684-c399327a465a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.427504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.429389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7752c-9707-45f7-ac6a-75c9f5570a7a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.445163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 409/814] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:50.447423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.447913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.448371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.474626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:50.475861 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:50.485684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.486539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.486779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.487054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] PATH_INFO: `/v3/services/network` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.487752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.489139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:50.503201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:50.504245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:30:50.505075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:50.507982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 406/815] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:50 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:50.508955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.579076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 410/816] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:50.580285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.653104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9d256-594c-4cd4-a82f-8dfda5afc259 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.664609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:50.698599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.700657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.700970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.701251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6da2eb51566940d7bee3a44f019e06ba/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.703787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=6da2eb51566940d7bee3a44f019e06ba, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.705482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.725067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc78b-14fe-4f5a-a142-58e02f572cc1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.727499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:50.729603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 407/817] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:30:50 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6da2eb51566940d7bee3a44f019e06ba/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:30:50.735938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.804984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.806073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.806560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.807062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.808007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:50.808613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:50.810329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:50.825758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 411/818] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:30:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:50.833174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.867884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef24d-e235-42c6-a81d-d6cedc27b0bb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:50.909892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:50.910639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:50.910921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:50.911197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:50.925954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:50.934550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:50.935621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:50.936459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:50.937084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 408/819] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:50.944189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:50.982896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:51.049350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03556-7a2a-4fcc-9673-471b02e261a1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:51.087799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a76b19-6ca4-4330-bb8c-b7864013a962 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:51.126755 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:51.127868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:51.128357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:51.128829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:51.130028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:51.130539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:51.130940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:51.131646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:51.131937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:51.132217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:51.132945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] RBAC: Adding query filter params (type=network) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:51.133254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:51.133527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:51.134627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:51.146709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 409/820] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:51.153640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 412/821] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:30:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:51.155312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:51.164446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:51.228649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:51.256918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:51.266279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7093-b014-417b-b44f-ce99d281431c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:51.327367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:51.328799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:51.329840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:51.330484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:51.332538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423efeb6-2725-4409-9191-926ae9c3f18b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:51.354435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:51.356279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:51.387215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:51.388954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:51.390069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:51.390069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:51.390069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:51.390069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:51.394297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 410/822] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:51.399895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:51.410143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:51.411059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:51.411559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:51.412086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:51.412995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:51.414683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:51.463270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 413/823] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:30:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:51.540037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab33136-20f2-4db9-8f70-9e8fcaf572a0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:51.617899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:51.618874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:51.619303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:51.619738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:51.620621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:51.621103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:51.622648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:51.634451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:51.643215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 411/824] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:51.646213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:51.773235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:51.792286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e5b8-3ae5-40f7-834c-d2c666564268 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:51.829848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:51.831020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:51.831543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:51.832025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:51.842693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:51.844473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:51.860925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:51.861896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:30:51.862805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:51.865483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 414/825] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:30:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:51.870643 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.003441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283159f-ae01-4545-affd-64e563916e16 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.044186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.048154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.048154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.048154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.048154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:52.048154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.048524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a012c-3386-4ae3-99da-bb3a142de980 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:52.072738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 412/826] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:30:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:52.078461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.179825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb15e4-3a00-498a-a9fa-61e36da5c317 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.194043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b45e-5a7c-41a6-b502-fb9ffb2c1d13 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.194360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b45e-5a7c-41a6-b502-fb9ffb2c1d13 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.194670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b45e-5a7c-41a6-b502-fb9ffb2c1d13 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.196025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 413/827] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:52.200938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.201222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.201503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.215585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.217052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.217510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.217955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.220768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:52.222205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:52.235583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.291844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.303103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.303720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 414/828] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:30:52.305131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:52.319794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.406905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 415/829] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:30:52.416396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.423342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098799-fae4-404a-b831-996a7c3dbf89 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.459251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303754e-6cb1-463c-a1fc-fb6e8eb3f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.460089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303754e-6cb1-463c-a1fc-fb6e8eb3f040 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.460372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303754e-6cb1-463c-a1fc-fb6e8eb3f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.460647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303754e-6cb1-463c-a1fc-fb6e8eb3f040 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.467751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.477282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303754e-6cb1-463c-a1fc-fb6e8eb3f040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d303754e-6cb1-463c-a1fc-fb6e8eb3f040 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:52.488654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:52.489771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:30:52.490820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:52.493271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 415/830] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:52.495416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fdb37-d68a-4102-9a5b-ae9d6ff3b0b5 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.495923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fdb37-d68a-4102-9a5b-ae9d6ff3b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.496400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fdb37-d68a-4102-9a5b-ae9d6ff3b0b5 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.498124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 416/831] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:52.499488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fdb37-d68a-4102-9a5b-ae9d6ff3b0b5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.522910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb250f8-553d-4f08-8b82-eca44182dfc6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.561220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.564994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.565799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.566075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.566351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.577203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.578649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-58972dfa-a46e-44a3-9897-579599a0e7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:52.597168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:52.598132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:52.599005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:52.599005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:52.599005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:52.599005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:52.599005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 416/832] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:52.599868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.599868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.600068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.618748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:52.620145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:52.623863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fdb37-d68a-4102-9a5b-ae9d6ff3b0b5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.659576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.660243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.660525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.660797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.661565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:52.661851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.663211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:52.672328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 417/833] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:52.673007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.695429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 417/834] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:52.695429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.726319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.785567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f3333-bf3a-4efe-a631-430e5c78514c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.796745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.805313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d90249-f3ba-4f35-bd96-6862141611a1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.824400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.824988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.825271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.825547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.826884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:52.827116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.828519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:52.840346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 418/835] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:52.840979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.845751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.846561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.847104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.847377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.857732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.859174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:52.878794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:52.879739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:52.880583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:52.880583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:52.880583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:52.880583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:52.880583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 418/836] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:52.880865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:52.948777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67ba8f-d223-4b51-8141-aa5827a53841 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.970401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:52.986696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:52.988039 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.988342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.988776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.989480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:52.990558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f8bb-e29e-4142-b9c5-0e9dad254b22 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:52.990856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:53.003304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:53.004327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:53.010491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 419/837] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:53.011292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.033202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.034071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.034422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.034709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.041031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.042667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.044289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:53.060039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:53.061510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:53.062385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 419/838] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:53.062844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.121230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ac3b8-eadc-4a28-9f0d-5c111903b02c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.157307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.157997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.158276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.158552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.159269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:53.159602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.160966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.166713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305ba0e-e592-447f-9887-d3954bfb3b41 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.174058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 420/839] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:53.174701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.207220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.207910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.208197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.208473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.209184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:53.209490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.210851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.215512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 420/840] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:53.216138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.219995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.268592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.277967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f457aa4-7d5d-477f-9c76-decbd27512e4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.312259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.312926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.313210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.313488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.314275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:53.314588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.316065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b82af-5ec5-4ed2-a37b-15f9f092605a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.316220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198088f-a220-4822-99fe-341faf19cdc1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.327560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 421/841] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:53.328784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53647-3392-460e-acea-6fbe0862cd2e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.329074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53647-3392-460e-acea-6fbe0862cd2e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.329357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53647-3392-460e-acea-6fbe0862cd2e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.330597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 422/842] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:53.332561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53647-3392-460e-acea-6fbe0862cd2e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.354188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.355009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.355299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.355612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.363956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.365383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:53.380187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:53.381089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:53.382015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 421/843] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:53.382586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.441454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53647-3392-460e-acea-6fbe0862cd2e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.450211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.475689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.476354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.476635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.476928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.477618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:53.477926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.479289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39329fa-e266-43d6-8d33-b393868ef475 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.484158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 423/844] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:53.485301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.485582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.485855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.490077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0977bb-b1b3-48d3-b1e1-b46d05a1ac4f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.505826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:53.507049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:53.519496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.531281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.531984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.532270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.532549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.533409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=17968a13a13d4ad49956f1276256e8c6) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:53.533727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.535216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.547433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 422/845] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/role_assignments?user.id=17968a13a13d4ad49956f1276256e8c6&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:53.547433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.615417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 424/846] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:53.631785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.689342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744cb73-56ba-4759-9116-edd01256ad53 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.720122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.731756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.731956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.732228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.733020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.733875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:53.734190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:53.736407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:53.762055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 423/847] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:53.763181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.774322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a7842-1504-4ff7-a01d-53cfe8006b03 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.831434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.831434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.831434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.831434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.852267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:53.861434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:53.862580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:30:53.863670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:53.865670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 425/848] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:53.874669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:53.884505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:53.901195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584d20-035e-4ced-90da-0ea63ba46039 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:53.942816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:53.943845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:53.944355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:53.944786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:53.984709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4749f-dcdb-4555-9921-e49bfa5b28fa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.009683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.023928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.024246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.024537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.024812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.025576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:54.025897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.027057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.027260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.028931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.041076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 426/849] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:54.042301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.115189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.147427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 424/850] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:30:54.148993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.161269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b974de-564f-4111-8ca7-95a6c624ef0b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.207787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.208599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.208879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.209153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.224016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.225485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:54.243811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:54.244760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:54.245644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:54.245644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:54.245644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:54.245644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:54.250257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 427/851] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:54.251508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.253038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.272795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de56d7-6963-42c0-b8ba-12989a122637 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.315791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.316641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.316969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.317292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.328336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.329938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:54.349152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:54.350101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:54.355930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:54.355930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:54.355930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:54.355930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:54.355930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 425/852] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:54.356794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.379236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bf87-759d-47fa-9866-52a0f3c3bc89 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.401569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.418519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.419168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.419482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.420306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.421040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:54.421346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.422831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.441628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 428/853] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:54.442836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.491346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67a74-c1dd-4694-9221-4cb48a36ed11 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.541086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.542316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.542813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.543548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.545491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:54.546222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.548463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.555707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95cfa1-ca1e-4ed4-b3e4-e73f29f725df None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.556842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.567545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 426/854] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:54.569382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.598172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.599504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.600007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.600522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.609314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.611217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:54.627226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:54.628179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:30:54.629083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:54.631637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 429/855] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:54.642315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.682152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.686126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc853568-94c4-4120-a85d-53f6d2efd027 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.723697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.724788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.725220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.725640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.733775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.735442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.743225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670293a7-6cbe-42a0-9fe6-c8ddc03ab00c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:54.750534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:54.751631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:54.752705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:54.759412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 427/856] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:54.760444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.780463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.781212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.781497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.781806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.782736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:54.783052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.784554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.808248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 430/857] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:54.809421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.827849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.870015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985e29c-086a-4fbc-a1f2-4dba049c9a4c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.905885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.907378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.908243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.908941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:54.910041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:54.910503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:54.912404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:54.923870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:54.932588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438c5c-b888-47fe-8d0e-7d36f015ce69 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:54.932930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 428/858] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:54.934735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:54.975541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:54.976539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:54.976906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:54.977992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.057627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70031-e0f1-4b59-87a8-82fdad482dfe None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:55.071603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.074550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:55.077546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:55.096854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:55.097822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.098198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.098626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.099597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=ffab8172e35f4150ac7303eeceb05738) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:55.100011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.101641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:55.111742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 429/859] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/role_assignments?user.id=ffab8172e35f4150ac7303eeceb05738&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:55.197521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:55.204312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 431/860] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:30:55.212831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:55.330830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb2080-fa77-4c25-bbe6-7d3202b9de93 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:55.367012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:55.367838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.368122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.368395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.382073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.383826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:55.403571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:55.405131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:55.406201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:55.406201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:55.406201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:55.406201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:55.408095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 430/861] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:55.415473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:55.521732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c1c7-596f-4355-96c9-162e55868ed8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:55.562394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:55.563164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.563480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.563758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.564493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:55.564803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.566184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144919a1-2bca-44e4-b4cc-9b9cbb6245e3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:55.579097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 432/862] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:55.584483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:55.607093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2260be-8931-4a01-acd8-d9f52b6fa903 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.607997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2260be-8931-4a01-acd8-d9f52b6fa903 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.608279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2260be-8931-4a01-acd8-d9f52b6fa903 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.609649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 433/863] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:55.614535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9e04-2c35-47d4-a2e7-cc92b5743d83 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.614824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9e04-2c35-47d4-a2e7-cc92b5743d83 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.615100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9e04-2c35-47d4-a2e7-cc92b5743d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.627580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:55.634260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fb2e9e04-2c35-47d4-a2e7-cc92b5743d83 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:55.635514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fb2e9e04-2c35-47d4-a2e7-cc92b5743d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:55.694509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:55.715665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 434/864] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:30:55.717624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793c92-4f14-4a92-953b-2a3d2ff8d474 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:55.725684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ef93-fa3d-4d5f-a1a0-296a6b7ec4a2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.725972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ef93-fa3d-4d5f-a1a0-296a6b7ec4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.726253 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ef93-fa3d-4d5f-a1a0-296a6b7ec4a2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.731555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 435/865] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:55.732984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.733280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.733558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.753412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:55.753610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:55.754206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.754492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.754719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:55.754816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.761729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.763176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:55.778999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:55.780503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:55.781417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 431/866] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:55.781889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:55.832233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 436/867] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:55.833114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:55.886172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:55.896672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e778b-fa01-4053-823d-661263aa5387 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:55.941187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:55.941855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.942132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.942231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff2b4-3a5b-4a86-8347-8ab587121e4f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:55.942405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.943139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.944876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:55.967869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:55.969078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 432/868] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:30:55 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:55.971832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:55.992586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:55.993516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:55.994306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:55.994306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:55.995357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:55.995823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:55.997583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:56.017370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 437/869] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:56.018814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:56.094745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1b0ed-65da-466b-ab2a-e0fa91580f28 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:56.132450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:56.133714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:56.134185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:56.134460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:56.134807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837d7c-41c2-4470-b1fc-3260d84abe58 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:56.135228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:56.136505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:56.150066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:56.151188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:56.152058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 433/870] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Jul 25 08:30:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:56.157728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:56.178924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:56.179435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:56.180319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:56.180652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:56.180865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:56.181700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6da2eb51566940d7bee3a44f019e06ba) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:56.182011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:56.183527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:56.195427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 438/871] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:56 2022] GET /identity/v3/role_assignments?user.id=6da2eb51566940d7bee3a44f019e06ba&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:56.281202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fc1e0-fd12-424c-b38c-2667035c9002 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:56.320276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:56.321330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:56.321824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:56.322339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:56.323277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:56.323841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:56.325446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aaa91-b0df-444d-b0af-bd6400471bfd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:56.331581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 434/872] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:30:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:30:56.338147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:56.381161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:56.451547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864be4f-1bb9-4126-a8af-5a32d2700c8d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:56.487486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:56.488497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:56.489044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:56.489518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:56.490435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:56.490959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:56.492562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dba53-a778-480a-9e15-aefd47056978 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:56.503551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 439/873] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:30:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:57.331587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b3c1-9601-4fcf-af0b-a1bf2cbc5081 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:57.332103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b3c1-9601-4fcf-af0b-a1bf2cbc5081 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:57.332209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b3c1-9601-4fcf-af0b-a1bf2cbc5081 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:57.333747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 435/874] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:57.339018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd684-47de-4763-af08-4b943f990c89 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:57.339427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd684-47de-4763-af08-4b943f990c89 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:57.339610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd684-47de-4763-af08-4b943f990c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:57.358980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-079cd684-47de-4763-af08-4b943f990c89 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:57.360226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-079cd684-47de-4763-af08-4b943f990c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:57.431009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 440/875] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:30:57.453294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b3c1-9601-4fcf-af0b-a1bf2cbc5081 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:57.537440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:57.567937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b3c1-9601-4fcf-af0b-a1bf2cbc5081 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:57.604008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:57.604797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:57.605084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:57.605360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:57.616539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:30:57.625277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:57.626174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:57.626992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 436/876] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Jul 25 08:30:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:57.632614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd684-47de-4763-af08-4b943f990c89 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:57.671685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:57.739691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd684-47de-4763-af08-4b943f990c89 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:57.774640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:57.775320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:57.775634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:57.775914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:57.776677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:57.776988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:57.778366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:57.787819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 441/877] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:30:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:57.793020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:57.897864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b630f4-77bc-4507-9413-5b23cf07e756 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:57.933702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:57.934499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:57.934787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:57.935059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:57.945786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:57.947236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:57.948982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:57.977257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:57.979335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:57.981564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:57.981564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:57.981564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:57.981564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:57.981564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 437/878] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:57.988527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.086316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.093858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060cee8-7931-43ae-b410-07bb115f3b9a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.128514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.129236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.129528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.129801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.130536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:58.130843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.132247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ba1fd-d19e-41d6-a464-b09fb597b97f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.145443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 442/879] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:58.150968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.172674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7fd82-acf4-4aee-9f79-072b2797d870 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.172987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7fd82-acf4-4aee-9f79-072b2797d870 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.176327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7fd82-acf4-4aee-9f79-072b2797d870 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.176327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 443/880] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:30:58.180563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.180850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.181125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.200757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:58.202548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:58.272016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38f69-fb56-4c8c-8bfd-c09ce2ead86e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.295558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 444/881] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:58.317732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.322534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.323675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.324164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.324642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.333608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.335863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-9bf64c74-01bd-41ae-951f-006adb77e106 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:30:58.353153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:58.354110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:30:58.355027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:58.361302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 438/882] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:58.361302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bc7e1-7511-4ff2-8516-3043525fba81 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.361302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bc7e1-7511-4ff2-8516-3043525fba81 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.361302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bc7e1-7511-4ff2-8516-3043525fba81 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.363906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 439/883] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:58.365072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bc7e1-7511-4ff2-8516-3043525fba81 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.407897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.425998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8398e-3b14-4b06-b4fd-7bee18b91f9f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.426269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.463979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.464783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.465064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.465336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.465991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.467408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.476018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bc7e1-7511-4ff2-8516-3043525fba81 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8f739dd2-8787-48e8-b173-0f21d8e5016e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:58.479669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:58.480639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:30:58.486876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 445/884] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:58.487996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.487996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.487996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.503712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:58.504895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:58.519082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.519864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.520146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.520420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.521255 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:58.521558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.522979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.551848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 440/885] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:58.552566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.583287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 446/886] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:58.584163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.656363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848869-65a9-4b05-86d5-67cfa02437cf None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.663367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.669128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.686173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6abd45-050f-4a2b-bc9c-3f162a1dd8ed None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.691200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.691886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.692176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.692457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.693172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:58.693480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.694855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06ccd9-101a-42b0-9eb8-7561d7fe2ac9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.699535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 441/887] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:58.700795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d202-9036-471b-a9f7-04d7fa89bc4f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.701117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d202-9036-471b-a9f7-04d7fa89bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.701398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d202-9036-471b-a9f7-04d7fa89bc4f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.706748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 442/888] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:30:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:30:58.707578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d202-9036-471b-a9f7-04d7fa89bc4f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.719764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdeeec-f7c1-4f9b-a1e1-19de78e6fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.720425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdeeec-f7c1-4f9b-a1e1-19de78e6fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.720711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdeeec-f7c1-4f9b-a1e1-19de78e6fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.720989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdeeec-f7c1-4f9b-a1e1-19de78e6fbf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.787258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdeeec-f7c1-4f9b-a1e1-19de78e6fbf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.788774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdeeec-f7c1-4f9b-a1e1-19de78e6fbf9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.806731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d202-9036-471b-a9f7-04d7fa89bc4f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.839860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.840646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.840926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.841198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.841869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.843210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:58.855210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:58.856390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:58.857761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 443/889] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:58.858561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.868525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.896906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 447/890] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:30:58.896906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.896906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.896906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.898308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:58.911304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:30:58.912526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:30:58.957014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb84a2-a0b0-48e4-be39-2a487c3d6e3f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:58.979047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 448/891] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:30:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:30:58.979884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:58.994111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:58.995160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:58.995682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:58.996182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:58.997143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:58.997455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:58.999182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.009063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 444/892] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:59.009063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.119418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210255-be70-4da9-93bd-0a4cb0c87623 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.133859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:59.144535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db311efa-c30c-47de-8dda-4e3a43cf5d55 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.146883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:59.160741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.161415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.161703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.161980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.162696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:59.163010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.164420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.168930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 449/893] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:30:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:59.168930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.184929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.185743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.186020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.186288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.196904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.198315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:30:59.215748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:59.217287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:59.218171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:30:59.218171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:30:59.218171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:30:59.218171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:59.218171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 445/894] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:30:59.218436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.274767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6e607-9711-49f8-9426-95ed0d0ff5fb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.308777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.309435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.309715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.309987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.310741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.312146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.316482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496b719-d701-4b97-83cc-7c37050d9214 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.327666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 450/895] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:30:59 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:30:59.328665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.364225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:59.372911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.373718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.373932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.374143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.374950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] RBAC: Adding query filter params (interface=public, service_id=588e4a49a0bf4e0f967ee5b93f42ac23, region_id=RegionOne) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:59.375264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.376750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.382805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 446/896] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/endpoints?service_id=588e4a49a0bf4e0f967ee5b93f42ac23&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:59.383459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.406180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:59.455839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5fbf9-eec5-4336-9970-1dc83abdda26 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.497410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.498053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.498603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.498886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.500099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:59.500099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.501758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.502998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2816a-985e-4f17-afb8-9d037742f65b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.506995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 451/897] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:59.507920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.552318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.553425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.553425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.553585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.554259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:59.554562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.556030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.570985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 447/898] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:59.576681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.639264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:59.646262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1368de8-96ce-4403-8813-34ab7eb92645 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.670792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:30:59.685085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.685796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.686082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.686361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.687110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.688468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.694704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 452/899] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:30:59.700732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369ee61-f647-408c-880e-f3603f77ff22 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.743356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.744613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.745164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.745676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.755028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.756539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:30:59.773009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:30:59.773959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:30:59.774812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 448/900] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:30:59.780187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:30:59.896944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72ee42-ac6b-400e-9510-b536ef437d91 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:30:59.932892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:30:59.933567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:59.933855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:59.934182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:59.934976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:30:59.935830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:30:59.937289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52daf09-e4ff-44de-8248-b067a0cf57fb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:30:59.950514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 453/901] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:59.956726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:00.061225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297a65-2f03-4847-becf-cd0d20853df7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:00.097395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:00.098065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:00.098337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:00.098610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:00.099521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] RBAC: Adding query filter params (role.id=359fda3c26744573afafeab4b67f4178, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=ffab8172e35f4150ac7303eeceb05738) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:00.099838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:00.101267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674440-a9f5-454a-9ef2-36c211839336 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:00.104443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:00.108930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 449/902] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:30:59 2022] GET /identity/v3/role_assignments?user.id=ffab8172e35f4150ac7303eeceb05738&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=359fda3c26744573afafeab4b67f4178 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:01.429908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ce71-076d-4274-9a8c-7268514a617e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.430479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ce71-076d-4274-9a8c-7268514a617e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.430479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ce71-076d-4274-9a8c-7268514a617e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.432178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 454/903] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:01.437807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668044-8568-4494-a595-a6d0dca5f473 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.438301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668044-8568-4494-a595-a6d0dca5f473 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.438452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668044-8568-4494-a595-a6d0dca5f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.458985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6d668044-8568-4494-a595-a6d0dca5f473 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:01.460211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6d668044-8568-4494-a595-a6d0dca5f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:01.536217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 450/904] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:01.558262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8ce71-076d-4274-9a8c-7268514a617e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:01.582734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:01.583797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e259-43fe-40b7-a556-9396b8f09176 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.584299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e259-43fe-40b7-a556-9396b8f09176 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.584778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e259-43fe-40b7-a556-9396b8f09176 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.586607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 451/905] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:01.591833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.592357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.592969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.614048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:01.615694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:01.680845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8ce71-076d-4274-9a8c-7268514a617e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:01.699440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 452/906] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:01.725415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:01.730155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:01.730978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.731259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.731663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.732873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:01.734249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:01.746831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:01.747926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:01.754864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 455/907] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Jul 25 08:31:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:01.757468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:01.800976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:01.844542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee430a-5e83-404b-8865-eddb701152f2 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:01.855787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:01.874935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c75283-d25d-4c76-ab3b-6883891001f8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:01.883327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f75d-15ee-4f81-aeb9-c445f6465d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:01.884113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f75d-15ee-4f81-aeb9-c445f6465d6b None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.884397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f75d-15ee-4f81-aeb9-c445f6465d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.884672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f75d-15ee-4f81-aeb9-c445f6465d6b None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.885387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065f75d-15ee-4f81-aeb9-c445f6465d6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:01.886748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065f75d-15ee-4f81-aeb9-c445f6465d6b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:01.902548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 453/908] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:01 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:01.903841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942b71-0b3e-4270-9424-9936cca8e3a2 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.904132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942b71-0b3e-4270-9424-9936cca8e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.904406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942b71-0b3e-4270-9424-9936cca8e3a2 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.905865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 454/909] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:01.911308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.911634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.911923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.927142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:01.928206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.928674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.929166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.930087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:01.930584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:01.932040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:01.932503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:01.933406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:01.940457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 456/910] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:01.947003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.015816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 455/911] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:02.038979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.094924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba0c19-c5d6-4535-8fd3-0394412344e4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.107125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.135462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.136140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.136973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.136973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.138079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:02.138079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.139123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c2e87-d9e0-4c3c-8c55-bfb28f4e131e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.144460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 457/912] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:02.145732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc6c9-7dd9-460e-b09f-0b19cf8c4f87 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.146023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc6c9-7dd9-460e-b09f-0b19cf8c4f87 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.146303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc6c9-7dd9-460e-b09f-0b19cf8c4f87 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.151371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 458/913] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:02.151371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bc6c9-7dd9-460e-b09f-0b19cf8c4f87 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.161813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.166602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fae27-6f0d-4314-88a6-22f49edc7101 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.204590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.205306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.205590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.205865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.206907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.208323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8b47113f-22de-41a7-a31c-31c8a6049ebb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:02.221290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:02.222717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:02.223578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 456/914] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:02.224370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.224370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.224370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.248556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:02.250761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:02.269491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bc6c9-7dd9-460e-b09f-0b19cf8c4f87 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.304128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.304772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.305056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.305330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.306119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] RBAC: Adding query filter params (interface=public, service_id=e849272a23e342b895c3f9c0d53b8c99, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:02.306432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.307828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.313361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 459/915] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/endpoints?service_id=e849272a23e342b895c3f9c0d53b8c99&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:02.314179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.331901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 457/916] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:02.333074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.380574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.399133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.432229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22cd5d-a685-43fd-b49c-0fff729c1bfc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.444699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017883b-2808-436e-99c6-6a9cedd85402 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.469136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.469725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.470008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.470282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.470986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:02.471292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.472941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.478141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 460/917] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:02.478976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.486795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.487497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.487788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.488071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.488768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.490143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.496951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 458/918] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:31:02.500306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.600351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344b92-a73a-4cc7-9b62-3693814e5423 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.642158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.643548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.644175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.644175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.647881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.657180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5e4af-a4d1-474b-9163-a9a915a2447b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.659996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:02.669311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:02.669867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:02.670782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:02.671635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:02.674351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 461/919] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:02.676899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.702999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.703770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.704317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.704607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.705332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:02.705646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.707556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.715420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 459/920] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:02.720418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.795628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93ec10-b8f4-4f2f-85a7-bcb42e0cb172 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.834718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.835321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.835743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.836089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.836923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:02.837303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.838982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.850157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 462/921] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:02.855057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.857650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3592-ca25-4849-b775-76b7ca5cb618 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.899770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.900483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.900771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.901210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.901958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.903516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.923349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:02.936151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 460/922] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:31:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:02.976591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0592a1-5883-4939-ae7c-084101c6411f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:03.025425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:03.026664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.027144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.027690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.042490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:03.044356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:03.064597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:03.065640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:03.066669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:03.066669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:03.066669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:03.066669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:03.069099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 463/923] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:03.075179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:03.109157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:03.188796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925f924-1288-4c4c-ba31-69612fa254d3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:03.223604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:03.224462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.224828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.225200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.226024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:03.226437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:03.227993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:03.241822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 461/924] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:03.247299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:03.352381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048d7a-21df-4e8a-83a4-3d791600ee0f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:03.360261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:03.389108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:03.390056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.390432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.390801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.398746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:03.400321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:31:03.416030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:03.417143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:31:03.418297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:03.420260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 464/925] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:31:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:03.425854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:03.521852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:03.541012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b75ab2-cf83-4fe9-a766-1ce4244b0cc5 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:03.583634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:03.584424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.584714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.584996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.585845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:03.586157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:03.587613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:03.612431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 462/926] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Jul 25 08:31:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:03.618326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:03.730311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693bd03-9641-4337-b6a6-8c2104872c2f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:03.766069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:03.767239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.767757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.768261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.779719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:03.781451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:03.799167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:03.800154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:03.801085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:03.801085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:03.801085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:03.801085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:03.803241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 465/927] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:03.809046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:03.915550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc0964-8be3-4a9c-933a-12d1ccd2b54e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:03.952376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:03.953388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.953891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.954369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.955290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:03.955828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:03.957405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab29e-8f41-4d81-a8d2-f05805676724 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:03.969650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 463/928] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:03.975868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:03.993472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc93b0-fe52-4f20-a560-08a954e04ab8 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:03.994063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc93b0-fe52-4f20-a560-08a954e04ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:03.994537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc93b0-fe52-4f20-a560-08a954e04ab8 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:03.996158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 464/929] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:04.005450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.005450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.005450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.007035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.017777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.022002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:04.024552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:04.098332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496ecc5-6336-4ac3-9bf7-14eff14c2f89 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.118155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 465/930] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:04.141117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.144360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.148014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.148538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.149186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.158160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.159859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:31:04.175114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:04.176251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:04.177140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:04.182409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 466/931] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:04.183511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.268522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c760732-fe68-4513-a2f5-9c2cd535fc5e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.280935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.308257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8b73-389b-41e5-bff2-a99b1a796d5d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.316441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.318052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.318505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.318950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.320280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.322578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.327156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:04.343052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:04.344436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:04.345491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:04.353648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 466/932] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:04.354670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.354863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.355576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.355861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.356162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.356914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:04.357266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.358696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.376033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 467/933] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:04.377335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.487738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e614d2a-0c71-4274-81ea-fb2aaecdc67b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.490914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae77fbf-28b5-484b-8767-b3780ce0413a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.532069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.533802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.534253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.534695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.535600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:04.536112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.537508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76d5c9-b958-433c-85f7-3f4d571376ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.537917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.538606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76d5c9-b958-433c-85f7-3f4d571376ac None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.538978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76d5c9-b958-433c-85f7-3f4d571376ac None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.539345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76d5c9-b958-433c-85f7-3f4d571376ac None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/ffab8172e35f4150ac7303eeceb05738/roles/359fda3c26744573afafeab4b67f4178` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.542082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76d5c9-b958-433c-85f7-3f4d571376ac None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=ffab8172e35f4150ac7303eeceb05738, role_id=359fda3c26744573afafeab4b67f4178)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.543652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76d5c9-b958-433c-85f7-3f4d571376ac None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.549534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 467/934] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:04.550703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.561096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.573027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 468/935] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:04 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/ffab8172e35f4150ac7303eeceb05738/roles/359fda3c26744573afafeab4b67f4178 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:31:04.639330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632a68-da45-4972-8675-df16f35ffbd0 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.639987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632a68-da45-4972-8675-df16f35ffbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.639987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632a68-da45-4972-8675-df16f35ffbd0 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.641463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 469/936] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:04.643376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.648135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.648483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.648761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.674012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:04.675247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:04.691002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0ee11-396e-4e20-97ad-e47a4e49e52c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.730375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.731167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.731504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.731794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.733158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:04.733470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.735121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.746486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 468/937] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:04.747458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.755931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 470/938] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:04.781134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.861932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b92cc-071b-471c-8ecf-f497b97464ea None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.893124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.903937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.904972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.905343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.905825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.907027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] RBAC: Adding query filter params (interface=public, service_id=a41eaf89cbaa444ea1efc91301d62317, region_id=RegionOne) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:04.907606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.908975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.909415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c2f27-5aec-4f6f-92b3-dbc9cb0cf767 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.915712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 469/939] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/endpoints?service_id=a41eaf89cbaa444ea1efc91301d62317&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:04.921417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.943668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:04.953361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.954811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.954811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.955150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.955918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.957394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:04.971663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:04.973137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:31:04.974179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:04.976529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 471/940] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:04.982224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:05.071975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d95c-988c-49b9-9300-3ee1a9bf70cf None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.106201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582b3cd-0406-4b4c-91c9-fb13fa7c2d74 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.118622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904deaa-fe24-433e-8765-10b74334af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.119783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904deaa-fe24-433e-8765-10b74334af6f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.120062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904deaa-fe24-433e-8765-10b74334af6f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.121041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904deaa-fe24-433e-8765-10b74334af6f None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.121740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904deaa-fe24-433e-8765-10b74334af6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.123135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904deaa-fe24-433e-8765-10b74334af6f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.131420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 470/941] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:31:05.134087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501f89-e3a3-4213-90a0-1dddecc2e9ce None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.134546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501f89-e3a3-4213-90a0-1dddecc2e9ce None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.134965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501f89-e3a3-4213-90a0-1dddecc2e9ce None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.137105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 471/942] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:05.146182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.146383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.146643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.163028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.164106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.164637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.165116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.166098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:05.166607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.167178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:05.168437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:05.168751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.175189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 472/943] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:05.181722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:05.255980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:05.259189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:05.276095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 472/944] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:05.298531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:05.321135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a29f1-34b1-4b29-97a8-fda80f24c79a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.361063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.362008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.362298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.362572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.363283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:05.363632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.365647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.375466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 473/945] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:05.380239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:05.420416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287b1dd-6c81-4866-94b9-fc394afa20a9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.458412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.459102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.460006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.460288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.461281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.463012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.466573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING keystone.server.flask.common [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 08:31:05.492180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.sql.core [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 08:31:05.492180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 08:31:05.492180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [parameters: {'id': '205ef043d93b4b7ea70d6daed15f8d74', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 08:31:05.492180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80321) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 08:31:05.499457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8b6b-1252-48d7-bda7-5d585c64cdb1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 205ef043d93b4b7ea70d6daed15f8d74.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 205ef043d93b4b7ea70d6daed15f8d74. Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:31:05.515530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result.read() Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 08:31:05.516474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application yield resource Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise self.value Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application session.commit() Jul 25 08:31:05.517402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.session.flush() Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application compat.raise_( Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 08:31:05.518901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 08:31:05.520552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result.read() Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:31:05.523723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [parameters: {'id': '205ef043d93b4b7ea70d6daed15f8d74', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:05.524624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:05.525418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 205ef043d93b4b7ea70d6daed15f8d74. Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 473/946] 10.222.0.57 () {60 vars in 1140 bytes} [Mon Jul 25 08:31:05 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:05.526292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:05.534289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:05.556460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.557370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.557861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.558357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.559320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.561578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.580463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:05.585162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 474/947] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:31:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:05.657396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbe31-8dd0-4636-8678-ec51bce95cd0 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.707376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.708483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.708918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.709395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.718204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.720105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-5605e890-26b2-4e82-9878-8da30e4ad9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:31:05.736602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:05.737727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:05.738812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:05.740693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 474/948] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:05.746661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:05.856916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e98e3-a13f-4c79-b371-40180210d9ff None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:05.891590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:05.892486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:05.892943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:05.893375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:05.894279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:05.894739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:05.896357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e426-35d6-4861-b809-1d0ee28b793a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:05.914734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 475/949] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:06.675434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bded904-ee2c-4d68-88f5-3232e49d5143 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.675973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bded904-ee2c-4d68-88f5-3232e49d5143 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.675973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bded904-ee2c-4d68-88f5-3232e49d5143 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.677589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 475/950] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:06.682873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.683162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.683464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.702747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:06.703946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:06.734321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:06.776249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 476/951] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:06.798143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bded904-ee2c-4d68-88f5-3232e49d5143 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:06.899045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:06.903695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bded904-ee2c-4d68-88f5-3232e49d5143 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:06.940789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:06.941747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.942037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.942438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.954708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:06.963036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:06.964001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:06.964846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 476/952] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Jul 25 08:31:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:06.970535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.075266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c0576-a696-44c4-8c6a-21e0867df40a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.110983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.111693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.111973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.112248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.113000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.113305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.114684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360610f6-79de-44db-8f89-021173ef7df6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.124336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 477/953] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:31:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:07.130182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.237917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195870b5-d802-4a61-a278-7df8ec649bce None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.273237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.274396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.274920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.275418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.286777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.288547 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.303880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19603-11d3-45ba-8e62-4120c72bd7ab None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.304190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19603-11d3-45ba-8e62-4120c72bd7ab None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.304455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19603-11d3-45ba-8e62-4120c72bd7ab None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.306100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 478/954] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:07.308410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:07.309308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:07.310251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:07.310251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:07.310251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:07.310251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:07.311143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.311451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.311736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.313194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 477/955] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:07.319424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.332145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.335973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:07.337607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:07.365823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.428791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 479/956] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:07.438236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df84b-d89e-447a-8017-b7af28b1ec3a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.446514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.478744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.480142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.480654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.481150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.482167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.483256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.485043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.499451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 478/957] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:07.505055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.575772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39b05-bd94-4ea2-9faa-d5af6d731d43 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.597636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.617178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.618425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.618915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.619419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.620286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.621944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.634027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5be3a-3f5e-479b-8d36-442cb16627eb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:07.636427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:07.637515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:07.638424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:07.646081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 480/958] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:07.647285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.675201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.675738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.676693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.676842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.677379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.688181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.691897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-096c6700-5068-4fb1-ba1d-f00e1df28635 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:31:07.711259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:07.712279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:31:07.713221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:07.714390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 479/959] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:07.714588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7ccb-eaef-4f42-95ee-ef2ee3e34197 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.714851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7ccb-eaef-4f42-95ee-ef2ee3e34197 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.715127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7ccb-eaef-4f42-95ee-ef2ee3e34197 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.716960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 480/960] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:07.718596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee7ccb-eaef-4f42-95ee-ef2ee3e34197 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.770193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45568f48-4241-4203-8b46-506f47c6eec1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.804830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.805615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.805784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.806067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.806793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.807094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.808510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c902c5a-4729-4c5c-a2a9-8a3cdcaf5b61 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.814191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 481/961] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:07.819945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.820239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.820525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.827691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee7ccb-eaef-4f42-95ee-ef2ee3e34197 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.838186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:07.839415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:07.859943 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.867037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.867872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.868190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.868474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.869366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.869677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.871209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.896778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 481/962] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:07.896778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.920273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 482/963] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:07.920273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.944044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.009110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320cb35-fa30-4a29-a6a6-98e3269dfe4e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.034878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c5bd7-89a9-42d5-b678-09ef35068faa None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.044454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.045852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.046336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.046828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.048075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:08.048608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.049990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.056299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 482/964] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:08.057113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.074452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7d213-d6cb-4ef0-93d8-5e8d9e4c8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.075114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7d213-d6cb-4ef0-93d8-5e8d9e4c8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.075413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7d213-d6cb-4ef0-93d8-5e8d9e4c8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.075752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7d213-d6cb-4ef0-93d8-5e8d9e4c8cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.113760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.146939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7d213-d6cb-4ef0-93d8-5e8d9e4c8cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.148431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7d213-d6cb-4ef0-93d8-5e8d9e4c8cb2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.161093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118480-8e62-4419-a4e0-c2f49b657aa3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.165985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.195703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.196485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.196772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.197043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.197691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.199050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:08.210838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:08.212051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.213091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 483/965] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:08.214071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.256547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 483/966] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:08.257864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d0674-788a-48a9-b4ed-b452766bc578 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.258152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d0674-788a-48a9-b4ed-b452766bc578 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.258429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d0674-788a-48a9-b4ed-b452766bc578 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.259720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 484/967] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:08.260395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d0674-788a-48a9-b4ed-b452766bc578 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.318613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8455-9f51-40f6-8459-b2bdc061f371 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.334149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.352704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.353355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.353635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.353910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.354636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.356017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.363031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d0674-788a-48a9-b4ed-b452766bc578 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.375761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 484/968] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:31:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:08.376548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.380732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.409530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.410274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.410542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.410812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.411629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:08.412071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.413622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c174-13e5-41ea-8da7-492d9924ac87 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.423594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 485/969] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:08.425465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.425753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.426034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.444998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:08.446231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:08.498221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6939d-d068-4c5e-885a-5d6403afc4c1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.523656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 486/970] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:08.524745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.551496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.552496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.552846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.553146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.565494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.567056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:08.585266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:08.586337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:08.587724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:08.587724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:08.587724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:08.587724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.588010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 485/971] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:08.588793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.615147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.648270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbb69-a156-479b-9ecf-84afeebb54af None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.656272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.683788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.684543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.684898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.685173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.685919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:08.686260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.687678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.693329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 487/972] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:08.693935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.714239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389e578-9c69-4d8a-aab5-66c1b2652fe5 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.755533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.756632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.757146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.757625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.758541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.760305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.777434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.sql.core [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 08:31:08.777434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 08:31:08.777434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [parameters: {'user_id': '825d7f8904de43fe8793f5371476e3be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 08:31:08.777434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80321) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result.read() Jul 25 08:31:08.786655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:31:08.787640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application yield resource Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise self.value Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application session.commit() Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 08:31:08.788567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.session.flush() Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application compat.raise_( Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 08:31:08.789466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:31:08.790378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application result.read() Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:31:08.791216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [parameters: {'user_id': '825d7f8904de43fe8793f5371476e3be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:08.793939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 08:31:08.795914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 08:31:08.798134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 08:31:08.798134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 08:31:08.798134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 08:31:08.798134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 08:31:08.798134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 08:31:08.798134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:08.806541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 486/973] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Jul 25 08:31:08 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:08.808419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.808841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542b74-ee44-4a5e-b3ac-07906815016e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.849174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.849765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.850047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.850319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:08.851042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:08.851348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:08.853658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:08.865977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 488/974] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:08.871684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:08.905692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.932158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:08.952645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d662b-1e5c-43fd-b225-2e5980a1da51 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.986216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533094-9e6a-421b-9126-b70b906cd224 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:08.997265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:08.998599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:08.998890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:08.999166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.007650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:09.009293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:09.022384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:09.023235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.023572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.023851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:31:09.025719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:09.026612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:31:09.027623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:09.031166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:09.031936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 487/975] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:09.032796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:09.033271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:31:09.048245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:09.050276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:09.052492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:09.055425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 489/976] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:09.056643 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:09.145574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed1d81-e76d-4a00-9cac-ce752f40b704 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:09.158173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:09.169421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b342-1a96-4b10-8844-5a21d0bb76cd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:09.183157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:09.183878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.184168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.184447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.185268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:09.186133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:09.187707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726f4fa-820b-4675-833f-735371f67f1d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:09.207793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:09.208460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.208744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.209021 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.209810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:09.210121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:09.211577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:09.228749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 490/977] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:09.229617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:09.231569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 488/978] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:09.345073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0075533-a47a-46da-9ec3-111630119f51 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:09.382585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:09.383339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.383714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.384059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.384964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] RBAC: Adding query filter params (role.id=359fda3c26744573afafeab4b67f4178, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=ffab8172e35f4150ac7303eeceb05738) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:09.385345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:09.386836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98149e-0a6b-486c-b79e-745128009104 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:09.399556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 491/979] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:09 2022] GET /identity/v3/role_assignments?user.id=ffab8172e35f4150ac7303eeceb05738&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=359fda3c26744573afafeab4b67f4178 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:10.456233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e527-c607-4fe2-9e53-1f9cdb5cc353 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.456783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e527-c607-4fe2-9e53-1f9cdb5cc353 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.456783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e527-c607-4fe2-9e53-1f9cdb5cc353 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.458391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 489/980] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:10.463363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.463829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.463989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.482250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:10.483445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:10.493419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.562072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 492/981] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:10.583765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1e527-c607-4fe2-9e53-1f9cdb5cc353 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.587630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.688748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1e527-c607-4fe2-9e53-1f9cdb5cc353 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.721845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.722839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.723119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.723404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.724079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:10.725450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-84631cfc-1a0b-4be2-a3b7-8c85c07f72a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:10.738045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:10.738997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:10.740397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:10.741564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 490/982] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:10.745361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.753931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed36d2-837a-47c0-aaa6-c3e76d84b2d1 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.754221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed36d2-837a-47c0-aaa6-c3e76d84b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.754499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed36d2-837a-47c0-aaa6-c3e76d84b2d1 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.756007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 491/983] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:10.760469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.760760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.761032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.780573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:10.782072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:10.847233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.854262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 492/984] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:10.855232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2cfe4-0dad-4e93-83c3-28155a266c97 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.875767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.890487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.891151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.891765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.891765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.892427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:10.892733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:10.894096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:10.899443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 493/985] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:10.905327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.915663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.981493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541c41-9f0f-4949-a51b-2d5dc10c8ec4 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.017059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.017726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.018015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.018293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.019016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.020402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328334-2653-4ec9-8bc6-ac1c45772743 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.020509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.039556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 493/986] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:10 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:11.068146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.068948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.069295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.069641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.070439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:11.070819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.072361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.078850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 494/987] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:11.084648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.151041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.204371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f40853-6382-4ef6-8967-d804e440ca9f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.239583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.240135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.240424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.240701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.241509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] RBAC: Adding query filter params (interface=admin, service_id=a41eaf89cbaa444ea1efc91301d62317, region_id=RegionOne) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:11.241827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.243199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8317dd0-1506-4273-8969-9083721a077c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.249869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 494/988] 10.222.0.57 () {56 vars in 1249 bytes} [Mon Jul 25 08:31:11 2022] GET /identity/v3/endpoints?service_id=a41eaf89cbaa444ea1efc91301d62317&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:11.255261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.334794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.370368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864355a-77a7-46e6-80b1-c3ee546dfe4c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.405889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01583bd7-e7a2-4aed-b821-b71e32f48cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.406558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01583bd7-e7a2-4aed-b821-b71e32f48cfd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.406845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01583bd7-e7a2-4aed-b821-b71e32f48cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.407122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01583bd7-e7a2-4aed-b821-b71e32f48cfd None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.407843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01583bd7-e7a2-4aed-b821-b71e32f48cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.409212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01583bd7-e7a2-4aed-b821-b71e32f48cfd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.423432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 495/989] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:31:11 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:31:11.430050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6af1-1aa2-4e0c-a568-6d659c0dba3d None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.430344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6af1-1aa2-4e0c-a568-6d659c0dba3d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.430624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6af1-1aa2-4e0c-a568-6d659c0dba3d None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.432121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 495/990] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:11.438613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.438906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.439193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.459334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:11.460587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:11.539283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 496/991] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:11.563657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6af1-1aa2-4e0c-a568-6d659c0dba3d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.673765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6af1-1aa2-4e0c-a568-6d659c0dba3d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.697705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.710124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.710920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.711208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.711517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] PATH_INFO: `/v3/services/image` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.712177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.713538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:11.726308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:11.727275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:11.728121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 496/992] 10.222.0.57 () {56 vars in 1105 bytes} [Mon Jul 25 08:31:11 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:11.734510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.797452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.837215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44260bbd-72b3-4630-bc24-9957a5b537f3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.872530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.873227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.873512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.873792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.874504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] RBAC: Adding query filter params (name=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:11.874818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.876229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa56ff-722b-4ec3-8d4f-27051cc94e98 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.881664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 497/993] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:11.887423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.988555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e76ba-a1ec-4b97-be26-91b76768613c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:12.020726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:12.021378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:12.021658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:12.021931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:12.022632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] RBAC: Adding query filter params (type=image) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:12.022936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:12.024331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247fa8-01db-4a79-8810-7590e8539904 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:12.033511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 497/994] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:13.083249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13b32-2674-4f51-b50e-4a4b2375b65a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.083799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13b32-2674-4f51-b50e-4a4b2375b65a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.083909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13b32-2674-4f51-b50e-4a4b2375b65a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.085371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 498/995] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:13.090411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.090792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.090971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.110137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:13.111352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:13.160276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:13.182411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 498/996] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:13.205053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13b32-2674-4f51-b50e-4a4b2375b65a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.306735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13b32-2674-4f51-b50e-4a4b2375b65a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.332891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:13.342185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.342896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.343173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.343498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.344129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.345486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-30e3287b-eafe-4590-99fd-7e11b3b5e77e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:13.357311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:13.358273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:13.359119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 499/997] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:13.364629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.419230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489d116-6fcd-486f-b5af-705a8eb27b4b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.419580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489d116-6fcd-486f-b5af-705a8eb27b4b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.419813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489d116-6fcd-486f-b5af-705a8eb27b4b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.421333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 500/998] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:13.426371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.426970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.427260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.448505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:13.451999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:13.472412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462f294-c809-4520-a616-ce5bd1a03b54 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.508992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.509660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.509948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.510227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.510941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:13.511256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.512659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:13.518089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 499/999] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:13.523661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.533549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 501/1000] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:13.556146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.575669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:13.633848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3112e-a489-4d12-ba31-8c957516c245 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.664777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09463080-a2a0-4527-8544-c12b49d7d5b6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.672682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.673858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.674144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.674418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.675529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:13.675845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.677554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:13.682567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 500/1001] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:13.688743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.693695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:13.708966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.709773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.710057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.710331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.710992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.712398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:13.725209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:13.726287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:31:13.727139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:13.731835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 502/1002] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:13.733145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.792954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f74b3d-ef0a-4c30-92e0-81a0419ea8f6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.803379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:13.830071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.830728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.831008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.831281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.832099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] RBAC: Adding query filter params (interface=public, service_id=79e3bba947a44c908f826cca28a122c0, region_id=RegionOne) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:13.832403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.833768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:13.838950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 501/1003] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/endpoints?service_id=79e3bba947a44c908f826cca28a122c0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:13.844782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.856591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca35b4-0a91-4ce8-84a8-b90231b9f868 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.891466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.892140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.892523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.892866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.893591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:13.893888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.895260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:13.900585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 503/1004] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:13.906140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:13.955618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552cc80-07a6-4c50-bb88-e81c3dd56bdb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:13.963493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:13.991037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a69576-41b0-4d04-9002-a56f0cf8bac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:13.991795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a69576-41b0-4d04-9002-a56f0cf8bac9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:13.992080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a69576-41b0-4d04-9002-a56f0cf8bac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:13.992380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a69576-41b0-4d04-9002-a56f0cf8bac9 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:13.993071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a69576-41b0-4d04-9002-a56f0cf8bac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:13.994875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a69576-41b0-4d04-9002-a56f0cf8bac9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.007986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 502/1005] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:31:14.021639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71b9f-c544-484f-87aa-5b123ecf0db2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.042227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf7a2-6772-4e03-a253-0d56396e7cde None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.042508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf7a2-6772-4e03-a253-0d56396e7cde None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.042791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf7a2-6772-4e03-a253-0d56396e7cde None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.044437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 503/1006] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:14.050546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.050832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.051112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.064208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.064890 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.065171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.065502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.066229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:14.066534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.068055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.070643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:14.071911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:14.074134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 504/1007] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Jul 25 08:31:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:14.082255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.112990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.155328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 504/1008] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:14.178044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.202343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14f3f-6f3d-49d5-8cb2-27b14111b3ab None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.215588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.240472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890a98-0656-46f7-a609-87fef709730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.241136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890a98-0656-46f7-a609-87fef709730c None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.241415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890a98-0656-46f7-a609-87fef709730c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.241689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890a98-0656-46f7-a609-87fef709730c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.242420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890a98-0656-46f7-a609-87fef709730c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.243884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890a98-0656-46f7-a609-87fef709730c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.261735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 505/1009] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:31:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:14.285414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a853be-9f03-44c8-8587-8cc845ed30c4 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.331126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c50c-dddd-4486-bcee-2a0233a8c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.332064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c50c-dddd-4486-bcee-2a0233a8c0ff None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.332441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c50c-dddd-4486-bcee-2a0233a8c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.332817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c50c-dddd-4486-bcee-2a0233a8c0ff None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.333653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c50c-dddd-4486-bcee-2a0233a8c0ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.335145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c50c-dddd-4486-bcee-2a0233a8c0ff None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.359425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 505/1010] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:14 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:16.039627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17134-d406-4991-8181-5b92fb40d538 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.040148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17134-d406-4991-8181-5b92fb40d538 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.040148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17134-d406-4991-8181-5b92fb40d538 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.041566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 506/1011] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:16.047144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.047567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.047743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.066692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:16.067908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:16.085075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:16.146307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 506/1012] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:16.168050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17134-d406-4991-8181-5b92fb40d538 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.280764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17134-d406-4991-8181-5b92fb40d538 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:16.315276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:16.316019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.316307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.316584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.317242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:16.318611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0331645a-28dd-4470-83e7-50313d04ec24 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:16.330672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:16.331873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:31:16.332759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:16.334166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 507/1013] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:16.337925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.440358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fd659-6e44-4915-97d9-2d2a7cd30f6e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.440552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa386a8-2983-4f48-8812-6c70378c0c0d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:16.440674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fd659-6e44-4915-97d9-2d2a7cd30f6e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.440925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fd659-6e44-4915-97d9-2d2a7cd30f6e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.442411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 508/1014] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:16.447128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.447433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.447713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.465593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:16.467306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:16.480665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:16.481329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.481610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.481885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.483246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:16.483577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:16.484954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:16.494415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 507/1015] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:16.496352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.505406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:16.511669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:16.575459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 509/1016] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:16.587490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.606587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafbbf-cc2c-4e9c-b98d-44bde739e4cb None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:16.645878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:16.646947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.647470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.647955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.648867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:16.649377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:16.650933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:16.657005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 508/1017] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:16.662146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.700561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e91ba-026d-4281-9757-8d9090033920 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:16.742375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:16.747431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:16.748409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.748695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.749333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] PATH_INFO: `/v3/services/image` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.749992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:16.751366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:16.763991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:16.764999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:16.766451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 510/1018] 10.222.0.57 () {56 vars in 1105 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:16.771096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.772577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890197-6b02-4feb-ab4b-c3f87317f737 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:16.804069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:16.812518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c33b5-ad7c-4ef0-b243-4f9775958ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:16.813186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c33b5-ad7c-4ef0-b243-4f9775958ce7 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.813470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c33b5-ad7c-4ef0-b243-4f9775958ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.813782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c33b5-ad7c-4ef0-b243-4f9775958ce7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.814522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c33b5-ad7c-4ef0-b243-4f9775958ce7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:16.815930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c33b5-ad7c-4ef0-b243-4f9775958ce7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:16.846383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 509/1019] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:31:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:16.846383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8dfc-3697-4821-be24-714eefcde7cb None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.846383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8dfc-3697-4821-be24-714eefcde7cb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.846383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8dfc-3697-4821-be24-714eefcde7cb None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.846383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 510/1020] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:16.847503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.848061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.848338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.867520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:16.868753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:16.900506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6c26-5acc-41de-9d5b-a9dbd1284bfb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:16.959190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 511/1021] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:16.969551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:16.970240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:16.970528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:16.970810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:16.971567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] RBAC: Adding query filter params (name=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:16.971884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:16.973597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:16.982951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:16.984336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 511/1022] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:16.985259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:17.054810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:17.104368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b2697-61ee-4a22-a365-496aedbe9618 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.108048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:17.121973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c9d9-a273-476e-a4e8-f4f2e5a03d80 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.145407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.146217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.146505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.146784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.148016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.149472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.151129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 512/1023] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:17.157858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:17.169537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.170593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.171085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.171519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.172684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:17.173130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.175106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.187246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 512/1024] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:17.188689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:17.276232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647015-3203-4013-9bfc-f908ed7a1014 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.299613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287401bb-38ea-4759-8b50-601280585f89 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.305046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:17.316146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7ee79-4779-4a90-bc36-f1b1a0e8c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.316816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ee79-4779-4a90-bc36-f1b1a0e8c829 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.317103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ee79-4779-4a90-bc36-f1b1a0e8c829 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.317384 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ee79-4779-4a90-bc36-f1b1a0e8c829 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.318141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7ee79-4779-4a90-bc36-f1b1a0e8c829 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.319609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7ee79-4779-4a90-bc36-f1b1a0e8c829 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.337385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.338200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.338527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.338880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.340065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] RBAC: Adding query filter params (interface=public, service_id=ded41af9accf475a8f3de9c30ca84b03, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:17.340385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.341754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.352186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 513/1025] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:31:17 2022] GET /identity/v3/endpoints?service_id=ded41af9accf475a8f3de9c30ca84b03&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:17.352362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 513/1026] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:17 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:17.353885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:17.379187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:17.473271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fed8a-3d5b-4568-9e56-020067367cdb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.510528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc897047-99ca-4c42-9ef6-76c2d0710bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.511207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897047-99ca-4c42-9ef6-76c2d0710bdb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.511536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897047-99ca-4c42-9ef6-76c2d0710bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.512316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897047-99ca-4c42-9ef6-76c2d0710bdb None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.512512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897047-99ca-4c42-9ef6-76c2d0710bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.513929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897047-99ca-4c42-9ef6-76c2d0710bdb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.521013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 514/1027] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:31:17 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:31:18.975588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c32c-85ed-4dd9-8123-4e3c8691635c None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:18.976101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c32c-85ed-4dd9-8123-4e3c8691635c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:18.976101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c32c-85ed-4dd9-8123-4e3c8691635c None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:18.977465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 514/1028] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:18.982497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:18.982889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:18.983082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.001202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:19.002379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:19.071274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 515/1029] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:19.095215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3c32c-85ed-4dd9-8123-4e3c8691635c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.200161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3c32c-85ed-4dd9-8123-4e3c8691635c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:19.235409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:19.236140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.236421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.236692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.247259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:19.255966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:19.256879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:19.257746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:19.259125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 515/1030] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:19.263196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.278256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:19.364169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9cd3f-940b-4710-a332-ffa64824d314 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:19.398673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:19.399338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.399644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.399923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.400668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:19.400972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:19.402344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e3def-6be9-45ef-b557-b1d8cc19ed5b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:19.415002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 516/1031] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:19.416165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.456902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:19.519620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b4a12-f73f-4dea-bf63-702eab08427b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:19.533111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f22ac-6bbc-4518-a8ab-884b884ffbb4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.533396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f22ac-6bbc-4518-a8ab-884b884ffbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.533695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f22ac-6bbc-4518-a8ab-884b884ffbb4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.535068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 517/1032] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:19.540052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefbffd-1f6a-433b-a07e-5f2d9c2fed88 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.540344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefbffd-1f6a-433b-a07e-5f2d9c2fed88 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.540622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefbffd-1f6a-433b-a07e-5f2d9c2fed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.561645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-daefbffd-1f6a-433b-a07e-5f2d9c2fed88 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:19.562843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-daefbffd-1f6a-433b-a07e-5f2d9c2fed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:19.564399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:19.565232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.565521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.565799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.576822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:19.578339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-42557bef-77c4-44d1-9948-df172ca4632f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:19.596961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:19.598236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:19.599327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:19.599327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:19.599327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:19.599327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:19.599327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 516/1033] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:19.600133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6e899-26fb-4e3f-9bde-1492f7f7c608 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.600133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6e899-26fb-4e3f-9bde-1492f7f7c608 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.600291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6e899-26fb-4e3f-9bde-1492f7f7c608 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.601579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 517/1034] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:19.604177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6e899-26fb-4e3f-9bde-1492f7f7c608 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.634235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 518/1035] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:19.635622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.635806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.636080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.644948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:19.657669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:19.658873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:19.699950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:19.711306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6e899-26fb-4e3f-9bde-1492f7f7c608 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:19.726295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 519/1036] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:19.727043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.746815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:19.747505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.747818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.748707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.749435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:19.749744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:19.751198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:19.763040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 518/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:19.763764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.831652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413a0a5-8514-47af-a990-cce0943740cb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:19.860738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629026ed-cd75-4ce1-a4f9-18a26b6f095d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:19.874556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:19.875350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.875666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.875947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] PATH_INFO: `/v3/services/image` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.876604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:19.877987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:19.879926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:19.891006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:19.892049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:19.892880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 520/1038] 10.222.0.57 () {56 vars in 1105 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:19.893661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.898855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:19.899681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:19.899968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:19.900242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:19.901510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:19.902944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:19.909077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 519/1039] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:19.909077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:19.925333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:19.994238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acc06-df4d-418f-b0ca-c41e376eb03e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.006290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec06c1-6eff-46c8-88c4-750673e7838a None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.027191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.027987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.028277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.028553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.036696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.038149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.039365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.040179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.040464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.040745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.041455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] RBAC: Adding query filter params (name=image) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:20.041765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.043223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.048997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 520/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:20.049566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:31:20.053561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:20.054610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 521/1041] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:31:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:20.055842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.114720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:20.137833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:20.157047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4fca7-c74b-4e13-ba78-ddcc67072fde None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.161610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e5d82-1099-45ef-afec-2db98e5a197c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.191737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.192411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.192702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.192971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.193673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.195092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.201661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.202318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.202597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.202871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.203604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:20.203909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.205343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.210417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 522/1042] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:20.211193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.216303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 521/1043] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:20 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:20.217372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.335777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54574d63-b46a-48a3-95a9-ba581e83b0b4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.345058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41ec16-d201-468a-98b9-0bc5e89fe538 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.374719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:20.390637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.391282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.392090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.392227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.392329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.392620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.392963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.393301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.394327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.394437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:20.394717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.396094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.396376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.409364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:20.419452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 523/1044] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:31:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:20.425602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.429483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 522/1045] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:31:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:20.558701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe67f-0e32-4c62-aa07-897a29d70946 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.608846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.609504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.609790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.610061 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.666897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:20.694538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.696041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.802496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 524/1046] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:31:20.808046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.912032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b42b7-fd2e-4a86-a8f6-d91272ad64c7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:20.947666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:20.948778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.949278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.949763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.961201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:20.962945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:20.983225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:20.984344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:20.985452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:20.985452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:20.985452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:20.985452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:20.987317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 523/1047] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:20.992811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.069941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.094764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874273c-3ecd-493b-9e7f-8bfc020b9fd6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.129557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.130216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.130496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.130766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.131563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:21.131877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.133325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.149615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 525/1048] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:21.150792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.204386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.260487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351582-f439-4c16-92ba-3b9118aaa8f8 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.295908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.296745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.297033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.297307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.304186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.305642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:31:21.320559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:21.321432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:21.327993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 524/1049] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:21.328486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.449758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d51089-f5ca-43db-8212-20f795337539 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.485871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.486457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.486745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.487022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.487840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:21.488155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.489593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760385-c2c9-4b02-b01d-a4be20a0360a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.492174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.508804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 526/1050] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.510032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.627175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bba760-95c5-4b8b-8928-016a499671a8 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.634653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.668692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.669360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.669679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.669960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.670805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] RBAC: Adding query filter params (role.id=359fda3c26744573afafeab4b67f4178, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=17968a13a13d4ad49956f1276256e8c6) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:21.671122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.672588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b7159-7788-41a3-ae76-ad8021677b92 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.699434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 525/1051] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/role_assignments?user.id=17968a13a13d4ad49956f1276256e8c6&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=359fda3c26744573afafeab4b67f4178 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:22.342525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2964b1-86e3-4d96-a735-1300d262875e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.343049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2964b1-86e3-4d96-a735-1300d262875e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.343049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2964b1-86e3-4d96-a735-1300d262875e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.344689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 527/1052] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:22.349890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283552dd-38b9-4999-8e79-56260d2a7b91 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.350284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283552dd-38b9-4999-8e79-56260d2a7b91 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.350444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283552dd-38b9-4999-8e79-56260d2a7b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.368986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-283552dd-38b9-4999-8e79-56260d2a7b91 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:22.370179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-283552dd-38b9-4999-8e79-56260d2a7b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:22.440390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 526/1053] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:22.462714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2964b1-86e3-4d96-a735-1300d262875e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.519011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a1761-c630-4788-b58d-7e50b448b6ae None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.519296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a1761-c630-4788-b58d-7e50b448b6ae None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.519598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a1761-c630-4788-b58d-7e50b448b6ae None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.520982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 527/1054] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:22.525846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.526133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.526411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.544461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:22.546196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:22.576899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2964b1-86e3-4d96-a735-1300d262875e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.612907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.613617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.613902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.614176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.618042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 528/1055] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:22.624566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:22.632413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:22.633343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:22.634170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:22.635722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 528/1056] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:22.640110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.640383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.671247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.704939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.744547 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7f48-ba8d-469d-ab6a-7399c26b041f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.751535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca39cc-4f06-48d3-bf0a-e0dc4c5826c3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.781974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.782929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.783213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.783637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.784845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:22.785164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.786847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.789350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.790020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.790303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.790576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.798811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 529/1057] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:22.804449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.865358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.866994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.895912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.906441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06694172-96b5-4afc-a370-3c8844572be3 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.926447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.941317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.942194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.942478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.942754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] PATH_INFO: `/v3/users/513df7a08e9d4476b982e823a47faaa3` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.956725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] RBAC: Authorizing `identity:get_user(user_id=513df7a08e9d4476b982e823a47faaa3)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.958444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.964858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 530/1058] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/users/513df7a08e9d4476b982e823a47faaa3 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:22.965688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.974865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 529/1059] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:31:22.980657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.071188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e6b9c-57c9-4a7d-8902-2adf224ed573 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.083069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690ebf-c9e9-4c99-b93c-eee2e6b0b9ca None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.107586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.108560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.109095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.109523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.116257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.116984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.117266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.117541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.128083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.129520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.130674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:23.147942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:23.149034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:23.149915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:23.149915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:23.149915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:23.149915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:23.149915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 530/1060] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:23.155037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.165830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.190348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.191842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.267818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf253cc-2935-4d9e-a314-20d573a798a7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.306646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.307724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.308216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.308348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 531/1061] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:23.308817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.309768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:23.310798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.312411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.314477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.327723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 531/1062] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:23.374081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.432183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec503fb-5cb8-45b6-a2be-b801f40a59fe None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.483438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2b607-891e-427a-be89-a283ca4bba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.483438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2b607-891e-427a-be89-a283ca4bba0b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.483438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2b607-891e-427a-be89-a283ca4bba0b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.483438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2b607-891e-427a-be89-a283ca4bba0b None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.485106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2b607-891e-427a-be89-a283ca4bba0b None admin] RBAC: Authorizing `identity:get_project(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.486765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2b607-891e-427a-be89-a283ca4bba0b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.489549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 532/1063] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:23.496692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.585249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.627612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076de32-6951-4f08-bcac-bfa065146d6b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.671282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.672017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.672299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.672574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.673410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06, user.id=513df7a08e9d4476b982e823a47faaa3) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:23.673724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.675151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033d8e-e9c0-4a95-9d0b-0ea688cbc56b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.681243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 532/1064] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/role_assignments?user.id=513df7a08e9d4476b982e823a47faaa3&scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:23.736564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1939-7f1e-456b-9474-59b13385411c None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.736856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1939-7f1e-456b-9474-59b13385411c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.737314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1939-7f1e-456b-9474-59b13385411c None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.738789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 533/1065] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:23.744683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.744976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.745251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.765418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:23.766663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:23.837978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 533/1066] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:23.861698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1939-7f1e-456b-9474-59b13385411c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.960077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1939-7f1e-456b-9474-59b13385411c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.977712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.994999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.995856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.996140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.996416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.006860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:24.015675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:24.016639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:24.017474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 534/1067] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:24.022894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.081648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:24.119992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d52000-0950-4500-8e3f-0a9281028b68 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.155715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.156386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.156672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.156952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.157703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:24.158014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.159443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.167340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 534/1068] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:24.173576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.277550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707ed32-803d-4336-8f39-17af9a7e9798 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.311057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.311882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.312166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.312442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.322776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.324239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:24.340849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:24.341878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:24.342784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:24.342784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:24.342784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:24.342784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:24.342784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 535/1069] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:24.348206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.446073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1907181-decf-4cc5-b0aa-5e3c185b5a19 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.468530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:24.479428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.480083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.480369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.480641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.481361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:24.481667 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.483604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.495085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 535/1070] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:24.500803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.531896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:24.601312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b9cf-fdfc-4f2c-a3c5-e7f032795865 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.633762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.634544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.634827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.635100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.642533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.644000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:31:24.658257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:24.659353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:24.660803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 536/1071] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:24.665125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.763676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072cb9-075a-48ef-904e-99dba7e44a4f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.798869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.799554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.799844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.800122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.800963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:24.801278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.802721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.819564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 536/1072] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:24.825119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.914595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:24.924665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735ccc-9c2d-4a61-9220-024cefc5376b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.958872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.959669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.959950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.960221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.970913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.972375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:24.989201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:24.990271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:24.991378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:24.991378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:24.991378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:24.991378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:24.991378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 537/1073] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:24.996049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.043074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:25.099008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69084872-2bdf-4aa8-80a1-5796ad14b70c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.131510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.132164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.132446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.132721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.133432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:25.133736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:25.135104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:25.146671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 537/1074] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:25.152219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.250639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738ad8-c662-4b40-b5f5-1a3cfe4b9dc2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.283920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.284697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.284976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.285246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.291830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:25.293257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:31:25.307349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:25.308446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:25.309607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:25.311557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 538/1075] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:25.314761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.413969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48e4ff-a4cc-4361-b03a-f0db22f9a517 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.415445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:25.448061 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.448721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.449009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.449288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.450074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:25.450407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:25.452403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37eb2-91a6-4fcd-a044-c29025e33b97 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:25.464304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 538/1076] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:25.470030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.473223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:25.569607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ee80-74ae-47e4-85f9-3cfba504d9de None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.603043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9afcf-b1f0-42ae-bdcd-bfe2041aa63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.603956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9afcf-b1f0-42ae-bdcd-bfe2041aa63a None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.604239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9afcf-b1f0-42ae-bdcd-bfe2041aa63a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.604511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9afcf-b1f0-42ae-bdcd-bfe2041aa63a None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/17968a13a13d4ad49956f1276256e8c6/roles/359fda3c26744573afafeab4b67f4178` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.606673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9afcf-b1f0-42ae-bdcd-bfe2041aa63a None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=17968a13a13d4ad49956f1276256e8c6, role_id=359fda3c26744573afafeab4b67f4178)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:25.608760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9afcf-b1f0-42ae-bdcd-bfe2041aa63a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:25.621417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 539/1077] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:25 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/17968a13a13d4ad49956f1276256e8c6/roles/359fda3c26744573afafeab4b67f4178 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:25.652104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0825-a6c6-4044-885c-ffd3c67df058 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.652391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0825-a6c6-4044-885c-ffd3c67df058 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.652672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0825-a6c6-4044-885c-ffd3c67df058 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.654113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 539/1078] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:25.660201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.660488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.660766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.680440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:25.681569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:25.741617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:25.753881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 540/1079] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:25.775821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0825-a6c6-4044-885c-ffd3c67df058 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.875591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0825-a6c6-4044-885c-ffd3c67df058 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.909156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.909940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.910220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.910492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.920685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:25.928308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:25.929461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:25.935531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 540/1080] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:25.936229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.033219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa755f-557d-4663-b4dd-0abf17bae159 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.066903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.067599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.067885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.068163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.068910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:26.069219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.070595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.079414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 541/1081] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:26.084987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.109783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.184816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d27c-721a-49f7-817a-576bb6b29dc8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.221232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.222027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.222313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.222591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] PATH_INFO: `/v3/users/513df7a08e9d4476b982e823a47faaa3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.224068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] RBAC: Authorizing `identity:get_user(user_id=513df7a08e9d4476b982e823a47faaa3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.225508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.227303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 541/1082] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/users/513df7a08e9d4476b982e823a47faaa3 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:26.233069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.296016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.341261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397902a3-3f93-42bb-b5c8-ac624e4dcf17 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.377936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc9f0-a3e8-4c2f-8b18-dab4daec4b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.378793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc9f0-a3e8-4c2f-8b18-dab4daec4b4e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.379077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc9f0-a3e8-4c2f-8b18-dab4daec4b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.379355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc9f0-a3e8-4c2f-8b18-dab4daec4b4e None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.380554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc9f0-a3e8-4c2f-8b18-dab4daec4b4e None admin] RBAC: Authorizing `identity:get_project(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.381991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc9f0-a3e8-4c2f-8b18-dab4daec4b4e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.383734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 542/1083] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:26.389820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.478014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.488626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a2c4-c06e-4e4a-b052-69ffd02b05f6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.521160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3dd4c-06e0-4ed3-9c58-a97fc2af1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.522038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dd4c-06e0-4ed3-9c58-a97fc2af1bb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.522317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dd4c-06e0-4ed3-9c58-a97fc2af1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.522591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dd4c-06e0-4ed3-9c58-a97fc2af1bb8 None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06/users/513df7a08e9d4476b982e823a47faaa3/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.524560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3dd4c-06e0-4ed3-9c58-a97fc2af1bb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06, user_id=513df7a08e9d4476b982e823a47faaa3, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.525997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3dd4c-06e0-4ed3-9c58-a97fc2af1bb8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.539945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 542/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:26 2022] PUT /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06/users/513df7a08e9d4476b982e823a47faaa3/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:27.586785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4fcc9-4118-4752-97f1-af210aada16e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.587250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4fcc9-4118-4752-97f1-af210aada16e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.587365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4fcc9-4118-4752-97f1-af210aada16e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.588735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 543/1085] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:27.593955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.594356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.594522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.612544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:27.613726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:27.680918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 543/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:27.704671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4fcc9-4118-4752-97f1-af210aada16e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.803441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4fcc9-4118-4752-97f1-af210aada16e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.824785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.836601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.837394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.837674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.837945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.848361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:27.856491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:27.858088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:27.864165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 544/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:27.865313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.943566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.963316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569f1ca-752d-4764-8caf-b6f5c2d77bbd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.997702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.998912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.999195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.999495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.000243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:28.000547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.001918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.009795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 544/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.015495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.112864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2f33c-30be-47b4-adb1-a8ce1d0be3d4 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.145698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.146489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.146771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.147045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.157651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.159081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:28.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:28.177121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:28.178152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:28.178152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:28.178152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:28.178152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:28.178152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 545/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:28.183103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.283612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e2f7-318a-4b77-b3f6-6f348d45136d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.316687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.317341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.317626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.317901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.318620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:28.318924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.320325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.332328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 545/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.337929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.371122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.436704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df3e2-7da4-4046-bde2-42e861ae7652 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.469666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.470444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.470726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.471001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.478210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.479797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-2191daef-96c6-4982-a5bf-c89babb9fd4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:31:28.494019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:28.495198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:28.496188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 546/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:28.501384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.504246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.523612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536735c-9203-4f70-87b0-ddd8ca05c6d0 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.523912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536735c-9203-4f70-87b0-ddd8ca05c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.524218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536735c-9203-4f70-87b0-ddd8ca05c6d0 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.525611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 547/1092] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:28.530901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.531270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.531627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.549810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:28.551576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:28.604705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72451e3-05fb-4396-90f0-830ec3525699 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.618243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 548/1093] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:31:28.638485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.639090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.639376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.639686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.640523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:28.640832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.641187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.642258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.658914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 546/1094] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:28.664420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.665238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.722830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.740467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fdfa6-6df1-4211-9a53-19faa59e33d6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.765250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa7b9a-9007-43ac-8139-67886d1c242c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.773377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.774167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.774450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.774727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.784646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:28.792302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:28.793320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:28.794145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 549/1095] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:28.799989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.800314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.800959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.801240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.801513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.867486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.868934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.881720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.897752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b55e4-9337-43f1-9a9f-3f528f42240e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.926078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.930699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.931348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.931658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.931932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.932672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:28.932971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.934348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.942880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 550/1096] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:28.948523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.973431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 547/1097] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:31:28.974632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.053518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630ac2-8312-4390-baef-d48e48bc1801 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.080444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4913a7-68ae-46e8-8897-9aa4c62030a0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.086002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.086873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.087157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.087464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] PATH_INFO: `/v3/users/513df7a08e9d4476b982e823a47faaa3` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.088660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] RBAC: Authorizing `identity:get_user(user_id=513df7a08e9d4476b982e823a47faaa3)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.090099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.092283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 551/1098] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/users/513df7a08e9d4476b982e823a47faaa3 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:29.097828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.113997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.115985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.116797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.117079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.117351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.127631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.129070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:29.146116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:29.147070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:29.148172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:29.148172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:29.148172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:29.148172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:29.148172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 548/1099] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:29.152849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.167064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.195572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d29d2-d335-425c-a532-40ff04e1fcd5 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.228505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.229145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.229431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.229710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.252496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76c58-b7b0-4485-8cba-6c1ef41ccd6c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.286212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.286859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.287145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.287442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.288166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:29.288475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.289844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.297002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.298435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.301149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 549/1100] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:29.306548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.313382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.376596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.397338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 552/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:31:29.403109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.406604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be14f81-74e5-427e-9b32-aab60c527696 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.440166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.440960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.441270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.441611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.459606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.461149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:31:29.478329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:29.479426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:31:29.480335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:29.483536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 550/1102] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:29.485682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.504488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d1fa6-58af-4970-a6e9-b355f18fc6fe None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.518720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.540142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.540996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.541274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.541548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.542706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] RBAC: Authorizing `identity:get_project(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.544162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.546382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 553/1103] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:29.552317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.585038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543322-ab32-4a4f-8c9a-78f62f02b092 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.614324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.620312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.620967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.621247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.621523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.622304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:29.622614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.624618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.635991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 551/1104] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:29.642590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.650763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a1579-efb2-49da-976f-93592f7f75ab None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.684313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.684883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.685175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.686006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.686839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06, user.id=513df7a08e9d4476b982e823a47faaa3) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:29.687158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.688626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81650c61-7970-4263-830e-95b954ec6579 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.694387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 554/1105] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/role_assignments?user.id=513df7a08e9d4476b982e823a47faaa3&scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:29.751462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25281cd-d1c4-4a13-8a20-149a51af8f63 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.787427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.788105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.788392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.788670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.789519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] RBAC: Adding query filter params (role.id=359fda3c26744573afafeab4b67f4178, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=17968a13a13d4ad49956f1276256e8c6) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:29.789836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.791291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32d124-77bd-456d-a8c0-3dd809bce742 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.798704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 552/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/role_assignments?user.id=17968a13a13d4ad49956f1276256e8c6&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=359fda3c26744573afafeab4b67f4178 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:31.713610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfc76b-34f3-412d-b443-9b94b2a51651 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.714134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfc76b-34f3-412d-b443-9b94b2a51651 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.714134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfc76b-34f3-412d-b443-9b94b2a51651 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.715565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 555/1107] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:31.721247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.721641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.721808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.740449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:31.741628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:31.790203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:31.806216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 553/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:31.830115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfc76b-34f3-412d-b443-9b94b2a51651 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:31.876808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:31.929158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfc76b-34f3-412d-b443-9b94b2a51651 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:31.961954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7fa1a-f56b-493e-8cab-3c5e3cc16895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:31.962730 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fa1a-f56b-493e-8cab-3c5e3cc16895 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.963016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fa1a-f56b-493e-8cab-3c5e3cc16895 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.963292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fa1a-f56b-493e-8cab-3c5e3cc16895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.964486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7fa1a-f56b-493e-8cab-3c5e3cc16895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:31.965907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7fa1a-f56b-493e-8cab-3c5e3cc16895 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:31.968144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 556/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:31.973889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:32.068967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922725f-57d9-477f-bee1-b03ce579256d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:32.101366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd15be-e3c1-4ab8-9894-fe3b3ec1e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:32.102020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd15be-e3c1-4ab8-9894-fe3b3ec1e0db None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.102297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd15be-e3c1-4ab8-9894-fe3b3ec1e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.102568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd15be-e3c1-4ab8-9894-fe3b3ec1e0db None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.103268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd15be-e3c1-4ab8-9894-fe3b3ec1e0db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:32.104721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd15be-e3c1-4ab8-9894-fe3b3ec1e0db None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:32.125893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 554/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:31 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:34.154474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e1d54-a3c8-4600-9a5c-4781ee4b1b2e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.155068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e1d54-a3c8-4600-9a5c-4781ee4b1b2e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.155068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e1d54-a3c8-4600-9a5c-4781ee4b1b2e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.156453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 557/1111] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:34.161644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.162043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.162201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.180397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:34.181569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:34.215746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.247455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 555/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:34.270574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e1d54-a3c8-4600-9a5c-4781ee4b1b2e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.374376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e1d54-a3c8-4600-9a5c-4781ee4b1b2e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.387919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.407960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.408758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.409043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.409318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] PATH_INFO: `/v3/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.410800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] RBAC: Authorizing `identity:get_role(role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.412207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.413585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 558/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:34.419504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.515984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae636e5f-2aad-4805-b5aa-11df11e95070 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.549344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.550232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.550515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.550792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] PATH_INFO: `/v3/users/27f05b3ba0c64f519f8996a45c572f37` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.563760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] RBAC: Authorizing `identity:get_user(user_id=27f05b3ba0c64f519f8996a45c572f37)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.565206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.566842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 556/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/users/27f05b3ba0c64f519f8996a45c572f37 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:34.572587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.668790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4934c-56f4-4ef7-a6fc-6f93e70e6c0e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.700731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.701877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.702156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.702430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.750886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.769051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.770511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.864542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 559/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:34.870269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.900092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.968241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fa449-27b1-4862-aff8-d80eda7f1d5f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.000953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d9a14-a1d9-426a-a30c-fff67b59630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.001798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d9a14-a1d9-426a-a30c-fff67b59630b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.002080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d9a14-a1d9-426a-a30c-fff67b59630b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.002356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d9a14-a1d9-426a-a30c-fff67b59630b None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.003548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d9a14-a1d9-426a-a30c-fff67b59630b None admin] RBAC: Authorizing `identity:get_project(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.004970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d9a14-a1d9-426a-a30c-fff67b59630b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.006625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 557/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.012640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.091052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.111113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f528-a223-4eac-8646-22f5d0330fb7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.143938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.144582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.144867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.145143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.145967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] RBAC: Adding query filter params (role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06, user.id=27f05b3ba0c64f519f8996a45c572f37) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:35.146286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.147723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcd053-f9e7-4f8e-8b67-45e13ff0f380 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.153014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 560/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/role_assignments?user.id=27f05b3ba0c64f519f8996a45c572f37&scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.105507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856be8-a2b9-4c11-ae8c-6c80f8c38a08 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.106054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856be8-a2b9-4c11-ae8c-6c80f8c38a08 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.106054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856be8-a2b9-4c11-ae8c-6c80f8c38a08 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.107508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 558/1118] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:37.112649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.113076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.113203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.131044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:37.132277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:37.195707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 561/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:37.218796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6856be8-a2b9-4c11-ae8c-6c80f8c38a08 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.313892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.318871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6856be8-a2b9-4c11-ae8c-6c80f8c38a08 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.352675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.353510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.353794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.354068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] PATH_INFO: `/v3/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.355614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] RBAC: Authorizing `identity:get_role(role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.356939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.358340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 559/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.364859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.437593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.460256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54445c0d-f37c-4172-afeb-c4b1633e6904 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.492501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.493693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.493973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.494243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] PATH_INFO: `/v3/users/27f05b3ba0c64f519f8996a45c572f37` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.495431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=27f05b3ba0c64f519f8996a45c572f37)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.496859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.498998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 562/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/users/27f05b3ba0c64f519f8996a45c572f37 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.504689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.601603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff080ed-6113-4706-b3bf-533e49b4543d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.634871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ec1e7-15ca-460d-8cf5-6695a6bc8c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.635683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec1e7-15ca-460d-8cf5-6695a6bc8c89 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.635969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec1e7-15ca-460d-8cf5-6695a6bc8c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.636244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec1e7-15ca-460d-8cf5-6695a6bc8c89 None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.637417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ec1e7-15ca-460d-8cf5-6695a6bc8c89 None admin] RBAC: Authorizing `identity:get_project(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.638871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ec1e7-15ca-460d-8cf5-6695a6bc8c89 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.640574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 560/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.646633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.742254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d062d2-8aeb-4274-b9a8-bf4583431ba2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.774875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92115-18bd-44bb-835f-6743bc854ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.775774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92115-18bd-44bb-835f-6743bc854ce2 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.776057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92115-18bd-44bb-835f-6743bc854ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.776330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92115-18bd-44bb-835f-6743bc854ce2 None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06/users/27f05b3ba0c64f519f8996a45c572f37/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.778481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe92115-18bd-44bb-835f-6743bc854ce2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06, user_id=27f05b3ba0c64f519f8996a45c572f37, role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.779948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe92115-18bd-44bb-835f-6743bc854ce2 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.792119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 563/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:37 2022] PUT /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06/users/27f05b3ba0c64f519f8996a45c572f37/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:39.757020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3e43-02f8-443e-80a4-1027a82e48ca None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.757541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3e43-02f8-443e-80a4-1027a82e48ca None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.757631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3e43-02f8-443e-80a4-1027a82e48ca None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.758931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 561/1124] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:39.764077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.764445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.764631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.771798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.783222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:39.784429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:39.847351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 564/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:39.870213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c3e43-02f8-443e-80a4-1027a82e48ca None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.905073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.969425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c3e43-02f8-443e-80a4-1027a82e48ca None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.001646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.002483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.002764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.003036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] PATH_INFO: `/v3/roles/d920e0e037874d15881f1a22dc7e14a8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.004519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] RBAC: Authorizing `identity:get_role(role_id=d920e0e037874d15881f1a22dc7e14a8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.005884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.007212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 562/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:39 2022] GET /identity/v3/roles/d920e0e037874d15881f1a22dc7e14a8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.012889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.107811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf956e2-6413-4095-bcbe-c919d62b7fc3 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.139905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.140758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.141038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.141309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] PATH_INFO: `/v3/users/27f05b3ba0c64f519f8996a45c572f37` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.142477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] RBAC: Authorizing `identity:get_user(user_id=27f05b3ba0c64f519f8996a45c572f37)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.143921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.145521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 565/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/users/27f05b3ba0c64f519f8996a45c572f37 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.151011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.248912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d23e3-cac4-4980-83dc-50358593c66b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.250430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.283218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.283885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.284172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.284449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.350283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.351764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.446535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 563/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:40.453084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.455983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.550706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8579f-f455-47c2-b8f8-7b418ec19f2f None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.586770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe0716-16e2-4909-b7b6-ec07be1e2443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.587645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0716-16e2-4909-b7b6-ec07be1e2443 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.587929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0716-16e2-4909-b7b6-ec07be1e2443 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.588280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0716-16e2-4909-b7b6-ec07be1e2443 None admin] PATH_INFO: `/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.589374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe0716-16e2-4909-b7b6-ec07be1e2443 None admin] RBAC: Authorizing `identity:get_project(project_id=7f4bcac3ee5a422bb2ef2c634ea71b06)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.590797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe0716-16e2-4909-b7b6-ec07be1e2443 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.592559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 566/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/projects/7f4bcac3ee5a422bb2ef2c634ea71b06 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.598893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.601086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.696644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e805c1-e813-42db-be07-1f9fe7e5247d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.737876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.738520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.738810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.739084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.739937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] RBAC: Adding query filter params (role.id=d920e0e037874d15881f1a22dc7e14a8, scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06, user.id=27f05b3ba0c64f519f8996a45c572f37) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:40.740247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.741660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ef3f-7ca3-4f73-8909-58402d7c10e1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.747299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 564/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/role_assignments?user.id=27f05b3ba0c64f519f8996a45c572f37&scope.project.id=7f4bcac3ee5a422bb2ef2c634ea71b06&role.id=d920e0e037874d15881f1a22dc7e14a8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:42.754684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2016-d5a0-4a82-830f-489847f09549 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.755197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2016-d5a0-4a82-830f-489847f09549 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.755312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2016-d5a0-4a82-830f-489847f09549 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.756653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 567/1131] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:42.761835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.762280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.762375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.781230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:42.782416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:42.839811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.847269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 565/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:42.870911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2016-d5a0-4a82-830f-489847f09549 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.938614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.968598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2016-d5a0-4a82-830f-489847f09549 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.001398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c2ff4-9b3f-48a9-a695-72eacb6be625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.002169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c2ff4-9b3f-48a9-a695-72eacb6be625 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.002449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c2ff4-9b3f-48a9-a695-72eacb6be625 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.002722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c2ff4-9b3f-48a9-a695-72eacb6be625 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.003905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c2ff4-9b3f-48a9-a695-72eacb6be625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.005324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c2ff4-9b3f-48a9-a695-72eacb6be625 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.006903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 568/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:43.012723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.107830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f1a00-a061-4d83-9c34-49b9ca0da33a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.140392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491b596-3c0f-4715-90d7-4accdbb27068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.141031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491b596-3c0f-4715-90d7-4accdbb27068 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.141312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491b596-3c0f-4715-90d7-4accdbb27068 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.141584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491b596-3c0f-4715-90d7-4accdbb27068 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.142289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491b596-3c0f-4715-90d7-4accdbb27068 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.143753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491b596-3c0f-4715-90d7-4accdbb27068 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.168779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 566/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:43 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:45.185468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139033a-30b7-41f2-85d5-fa8492358937 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.186035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139033a-30b7-41f2-85d5-fa8492358937 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.186035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139033a-30b7-41f2-85d5-fa8492358937 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.187414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 569/1135] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:45.192631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.193034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.193204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.211493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:45.212678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:45.255358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:45.280110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 567/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:45.303886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139033a-30b7-41f2-85d5-fa8492358937 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.402999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139033a-30b7-41f2-85d5-fa8492358937 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.435436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de44e71-da4e-4d97-841c-c6b171a14cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.436263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de44e71-da4e-4d97-841c-c6b171a14cdd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.436499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de44e71-da4e-4d97-841c-c6b171a14cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.436777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de44e71-da4e-4d97-841c-c6b171a14cdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.437934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de44e71-da4e-4d97-841c-c6b171a14cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.439413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de44e71-da4e-4d97-841c-c6b171a14cdd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.441004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 570/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:45.446468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.543811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf40949-0829-4dea-a0bd-b8a9d4819238 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.577702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af0930-7db4-45d2-8bab-2d5b146b7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.578366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af0930-7db4-45d2-8bab-2d5b146b7d7d None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.578653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af0930-7db4-45d2-8bab-2d5b146b7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.578933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af0930-7db4-45d2-8bab-2d5b146b7d7d None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.579679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af0930-7db4-45d2-8bab-2d5b146b7d7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.581113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af0930-7db4-45d2-8bab-2d5b146b7d7d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.601592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 568/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:45 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:47.626404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342900-d26f-44a8-826c-ccfd8a2ef90b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.626920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342900-d26f-44a8-826c-ccfd8a2ef90b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.627015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342900-d26f-44a8-826c-ccfd8a2ef90b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.628373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 571/1139] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:47.633518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.633908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.634067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.651886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:47.653065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:47.679056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.719118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 569/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:47.742713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5342900-d26f-44a8-826c-ccfd8a2ef90b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.751336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.839835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5342900-d26f-44a8-826c-ccfd8a2ef90b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.873055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.873828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.874113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.874391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.884215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:47.891905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:47.893053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:47.894167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 572/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:47.899065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.996198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75968d89-60fa-4a59-8923-d556565a60a0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.028158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.028806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.029597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.029868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.030612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:48.030914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.032296 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.040084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 570/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:48.046255 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.109418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.142988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df189de9-57af-4f2f-81d5-49511966d369 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.174961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.175840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.176120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.176391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] PATH_INFO: `/v3/users/244c5fc323b849dfa2453d0a0b25839f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.189001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] RBAC: Authorizing `identity:get_user(user_id=244c5fc323b849dfa2453d0a0b25839f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.190424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.192077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 573/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/users/244c5fc323b849dfa2453d0a0b25839f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:48.197911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.226777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.298475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee41c7-8dce-4137-926f-045703ab3ee9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.333126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.333834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.334326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.334804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.402062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.403468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.428638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.500519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 571/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:48.506412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.603354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d0218-b2b9-4fba-a013-066a4290c277 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.626740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.637972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53284b-f5f1-4bdd-a3dc-c0a15e16af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.639407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53284b-f5f1-4bdd-a3dc-c0a15e16af25 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.639701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53284b-f5f1-4bdd-a3dc-c0a15e16af25 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.639975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53284b-f5f1-4bdd-a3dc-c0a15e16af25 None admin] PATH_INFO: `/v3/projects/e2e5bca4173942e7b554ca34671ca74b` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.641155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53284b-f5f1-4bdd-a3dc-c0a15e16af25 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e5bca4173942e7b554ca34671ca74b)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.642583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53284b-f5f1-4bdd-a3dc-c0a15e16af25 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.644336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 574/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/projects/e2e5bca4173942e7b554ca34671ca74b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:48.650517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.745308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ec8d4-0213-41fb-a61b-00a26955ceee None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.770820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.779404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.780050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.780331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.780605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.781420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=e2e5bca4173942e7b554ca34671ca74b, user.id=244c5fc323b849dfa2453d0a0b25839f) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:48.781726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.783228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f5649-02a4-4bb7-9bf6-0b09e2848c6c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.788509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 572/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/role_assignments?user.id=244c5fc323b849dfa2453d0a0b25839f&scope.project.id=e2e5bca4173942e7b554ca34671ca74b&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:50.733517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631deb-5a8b-4802-bd6e-ebd44368e359 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.734019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631deb-5a8b-4802-bd6e-ebd44368e359 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.734137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631deb-5a8b-4802-bd6e-ebd44368e359 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.735472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 575/1147] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:50.740696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.741059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.741256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.758945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:50.760155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:50.823932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 573/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:50.846144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631deb-5a8b-4802-bd6e-ebd44368e359 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.944259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631deb-5a8b-4802-bd6e-ebd44368e359 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.977056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.977828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.978113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.978389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.988831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:50.996533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:50.997609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:50.998647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 576/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:51.003442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.099101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f900bdd-7355-4dac-8be5-8a44cfc79540 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.118734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.132593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.133254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.133541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.133821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.134567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:51.134880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.136284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.144723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 574/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.150287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.203194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.254863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382aa9b-706d-4590-aab5-9b6cb2d147ea None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.287991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.288853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.289141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.289420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] PATH_INFO: `/v3/users/244c5fc323b849dfa2453d0a0b25839f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.290608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] RBAC: Authorizing `identity:get_user(user_id=244c5fc323b849dfa2453d0a0b25839f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.292064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.293705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 577/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/users/244c5fc323b849dfa2453d0a0b25839f => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.299427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.400824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776459fb-a6ff-4f2a-8243-acb5629ec172 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.434987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38840871-454f-41ea-ac44-3c1e007a31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.436389 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840871-454f-41ea-ac44-3c1e007a31a5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.436670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840871-454f-41ea-ac44-3c1e007a31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.436942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840871-454f-41ea-ac44-3c1e007a31a5 None admin] PATH_INFO: `/v3/projects/e2e5bca4173942e7b554ca34671ca74b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.438106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38840871-454f-41ea-ac44-3c1e007a31a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e5bca4173942e7b554ca34671ca74b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.439572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38840871-454f-41ea-ac44-3c1e007a31a5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.441222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 575/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/projects/e2e5bca4173942e7b554ca34671ca74b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.447355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.543823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c65a-1f47-44b0-86a6-9ebc2f158101 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.563329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.577095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe8094-de58-489d-b309-0821c95bb5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.577977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe8094-de58-489d-b309-0821c95bb5ff None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.578259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe8094-de58-489d-b309-0821c95bb5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.578531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe8094-de58-489d-b309-0821c95bb5ff None admin] PATH_INFO: `/v3/projects/e2e5bca4173942e7b554ca34671ca74b/users/244c5fc323b849dfa2453d0a0b25839f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.580618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe8094-de58-489d-b309-0821c95bb5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=e2e5bca4173942e7b554ca34671ca74b, user_id=244c5fc323b849dfa2453d0a0b25839f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.582044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe8094-de58-489d-b309-0821c95bb5ff None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.595259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 578/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:51 2022] PUT /identity/v3/projects/e2e5bca4173942e7b554ca34671ca74b/users/244c5fc323b849dfa2453d0a0b25839f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:53.579335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d225-1a54-4464-bf51-dba074f7cf6f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.579795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d225-1a54-4464-bf51-dba074f7cf6f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.579925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d225-1a54-4464-bf51-dba074f7cf6f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.581296 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 576/1154] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:53.586472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.586892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.587028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.604949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:53.606113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:53.671012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 579/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:53.694165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d225-1a54-4464-bf51-dba074f7cf6f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:53.744799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:53.795482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d225-1a54-4464-bf51-dba074f7cf6f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:53.827378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:53.828132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.828417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.828690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.839006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:53.847182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:53.848268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:31:53.849538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 577/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:53.854487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:53.948220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2e5b-f194-40b0-9dc4-4833d95e02a1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:53.958336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:53.981782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:53.982977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.983257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.983562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.984298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:53.984602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:53.985958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:53.993703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 580/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:53.999236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.094386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738df0-416b-4400-9263-c0a5d4e03c7a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.104657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.127721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.128573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.128858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.129129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] PATH_INFO: `/v3/users/244c5fc323b849dfa2453d0a0b25839f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.130302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] RBAC: Authorizing `identity:get_user(user_id=244c5fc323b849dfa2453d0a0b25839f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.131747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.133345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 578/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:53 2022] GET /identity/v3/users/244c5fc323b849dfa2453d0a0b25839f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:54.139377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.237177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9d7f-90cd-471b-9aea-993bb7d94c07 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.269723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.270472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.270718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.271020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.310643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.336768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.338206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.439482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 581/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:54.445420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.546892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9460-a518-40b0-aa05-26b90d96e900 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.581557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cb458-875b-4be5-874f-6d488d181c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.582403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb458-875b-4be5-874f-6d488d181c24 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.582683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb458-875b-4be5-874f-6d488d181c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.582959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb458-875b-4be5-874f-6d488d181c24 None admin] PATH_INFO: `/v3/projects/e2e5bca4173942e7b554ca34671ca74b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.584151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cb458-875b-4be5-874f-6d488d181c24 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e5bca4173942e7b554ca34671ca74b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.585579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cb458-875b-4be5-874f-6d488d181c24 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.587240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 579/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/projects/e2e5bca4173942e7b554ca34671ca74b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:54.593421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.661783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.690358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94903-dd75-4a27-8559-43842318f438 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.722945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.723859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.724150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.724425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.725246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=e2e5bca4173942e7b554ca34671ca74b, user.id=244c5fc323b849dfa2453d0a0b25839f) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:54.725554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.726963 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db9ca1-66f2-48ac-aed2-df22b15b9fa0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.732691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 582/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/role_assignments?user.id=244c5fc323b849dfa2453d0a0b25839f&scope.project.id=e2e5bca4173942e7b554ca34671ca74b&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:56.739753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4726-bb08-4630-b363-a8058d64d148 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.740281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4726-bb08-4630-b363-a8058d64d148 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.740380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4726-bb08-4630-b363-a8058d64d148 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.741668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 580/1162] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:56.746834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.747191 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.747423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.765160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:56.766348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:56.830356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 583/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:56.852445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4726-bb08-4630-b363-a8058d64d148 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:56.898874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:56.951483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4726-bb08-4630-b363-a8058d64d148 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:56.984707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:56.985333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.985616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.985890 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.050087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.051684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.094621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.148115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 581/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:31:57.154796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.217157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.250485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb27e4-389f-4b97-b1dc-f336be403102 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.283295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.284133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.284416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.284693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.291216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.292688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d7c4cbaa-8d04-48cc-a709-8f6656f5906d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:57.306634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:57.307846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:31:57.308766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 584/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:57.317597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.413983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ececa4-0731-40ed-b492-3fbd57f2e66f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.446589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.447238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.447546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.447821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.448534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:57.448835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.450216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be97aa-fe0f-4ce8-9ff8-a39c894b9ee6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.457752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 582/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:59.412756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45be4-6843-47df-84df-2f8f0154aabd None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.413288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45be4-6843-47df-84df-2f8f0154aabd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.413288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45be4-6843-47df-84df-2f8f0154aabd None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.414674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 585/1167] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:59.419896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957582-a123-49e7-ad76-97ed24a313ef None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.420269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957582-a123-49e7-ad76-97ed24a313ef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.420458 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957582-a123-49e7-ad76-97ed24a313ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.437993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-34957582-a123-49e7-ad76-97ed24a313ef None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:59.439170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-34957582-a123-49e7-ad76-97ed24a313ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:59.441888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.504981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 583/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:31:59.527772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45be4-6843-47df-84df-2f8f0154aabd None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.627140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45be4-6843-47df-84df-2f8f0154aabd None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.651633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.660879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9645-177b-4002-a52e-672bc3b7f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.661529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9645-177b-4002-a52e-672bc3b7f079 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.661815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9645-177b-4002-a52e-672bc3b7f079 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.662091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9645-177b-4002-a52e-672bc3b7f079 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.662880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba9645-177b-4002-a52e-672bc3b7f079 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:59.664229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba9645-177b-4002-a52e-672bc3b7f079 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:59.678939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 586/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Mon Jul 25 08:31:59 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:01.667187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8816da-feb6-4a73-8456-2b430acbdc37 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.667723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8816da-feb6-4a73-8456-2b430acbdc37 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.667834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8816da-feb6-4a73-8456-2b430acbdc37 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.669127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 584/1170] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:01.674974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.675346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.675565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.694479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:01.695776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:01.760281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 587/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:01.782386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8816da-feb6-4a73-8456-2b430acbdc37 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.880380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8816da-feb6-4a73-8456-2b430acbdc37 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.912110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d483d-7005-4893-9d40-791818527476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.912945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d483d-7005-4893-9d40-791818527476 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.913225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d483d-7005-4893-9d40-791818527476 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.913494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d483d-7005-4893-9d40-791818527476 None admin] PATH_INFO: `/v3/domains/e524fe50fbc149b7aed3f83d10be04cf` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.921966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:01.924572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d483d-7005-4893-9d40-791818527476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e524fe50fbc149b7aed3f83d10be04cf)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:01.926491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d483d-7005-4893-9d40-791818527476 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:01.928178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 585/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/domains/e524fe50fbc149b7aed3f83d10be04cf => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:01.933919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:02.034221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d69db-1fb5-473b-875c-27991ee67267 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.050487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:02.068772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a55ce4-dfe3-4349-974b-44b344dcb445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.069430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55ce4-dfe3-4349-974b-44b344dcb445 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.069719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55ce4-dfe3-4349-974b-44b344dcb445 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.070003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a55ce4-dfe3-4349-974b-44b344dcb445 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.070721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a55ce4-dfe3-4349-974b-44b344dcb445 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.072188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a55ce4-dfe3-4349-974b-44b344dcb445 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.097651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 588/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:32:01 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:04.086483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5e32-dcd5-4683-b43d-02c7828e4e3b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.087002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5e32-dcd5-4683-b43d-02c7828e4e3b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.087002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5e32-dcd5-4683-b43d-02c7828e4e3b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.088427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 586/1174] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:04.093627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.094056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.094193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.112706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:04.113884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:04.177440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 589/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:04.201125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5e32-dcd5-4683-b43d-02c7828e4e3b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.299782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5e32-dcd5-4683-b43d-02c7828e4e3b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.331642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e793121-6f9e-4ca1-8cb4-793fc26fb8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.332484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793121-6f9e-4ca1-8cb4-793fc26fb8ef None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.332764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793121-6f9e-4ca1-8cb4-793fc26fb8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.333036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793121-6f9e-4ca1-8cb4-793fc26fb8ef None admin] PATH_INFO: `/v3/domains/e524fe50fbc149b7aed3f83d10be04cf` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.334194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e793121-6f9e-4ca1-8cb4-793fc26fb8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=e524fe50fbc149b7aed3f83d10be04cf)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.335638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e793121-6f9e-4ca1-8cb4-793fc26fb8ef None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.337246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 587/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/domains/e524fe50fbc149b7aed3f83d10be04cf => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:04.343272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.440504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.444025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c91b1-cea2-4455-98f2-ea3c3fa3d742 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.478362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732fb12-e6b7-44bd-b3cb-c0870dc0bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.479027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732fb12-e6b7-44bd-b3cb-c0870dc0bf18 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.479312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732fb12-e6b7-44bd-b3cb-c0870dc0bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.479618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732fb12-e6b7-44bd-b3cb-c0870dc0bf18 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.480334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732fb12-e6b7-44bd-b3cb-c0870dc0bf18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.481767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732fb12-e6b7-44bd-b3cb-c0870dc0bf18 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.504550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 590/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:04 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:06.489409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298465-191c-4cce-a93c-3a6213edfe7b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.489999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298465-191c-4cce-a93c-3a6213edfe7b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.489999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298465-191c-4cce-a93c-3a6213edfe7b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.491323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 588/1178] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:06.496562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.496974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.497119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.518780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:06.519994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:06.585012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 591/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:06.607929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298465-191c-4cce-a93c-3a6213edfe7b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.673783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.707978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298465-191c-4cce-a93c-3a6213edfe7b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.744408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.745393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.745907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.746412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.757871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:06.766362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:06.767586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:32:06.768570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 589/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:06.773900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.853471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.869400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf9025-11b0-4781-a708-2636458747d5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.901906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.902558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.902843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.903125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.903927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:06.904237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:06.905607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:06.913379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 592/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:06.918947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.017183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcdf5f-8f45-483e-bbdc-1f4a6082bf8b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.042287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.050767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.051658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.051942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.052215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] PATH_INFO: `/v3/users/7c157e19ef5c4aa08dec4ec116a3c431` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.065588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] RBAC: Authorizing `identity:get_user(user_id=7c157e19ef5c4aa08dec4ec116a3c431)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.067027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.068692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 590/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/users/7c157e19ef5c4aa08dec4ec116a3c431 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:07.074375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.170949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccf0d8-8b5c-460a-94d4-a7b2c658e5e8 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.202960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.203613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.203899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.204174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.219162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.269183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.270557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.371402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 593/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:32:07.377265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.472455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6aa6f-d956-42b5-ac1a-16863733e343 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.505201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad2ea-af73-4f1c-8322-a8c9a85d2a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.506044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad2ea-af73-4f1c-8322-a8c9a85d2a3e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.506327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad2ea-af73-4f1c-8322-a8c9a85d2a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.506603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad2ea-af73-4f1c-8322-a8c9a85d2a3e None admin] PATH_INFO: `/v3/projects/6241128caa7a4205bcefe609b1398140` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.507792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaad2ea-af73-4f1c-8322-a8c9a85d2a3e None admin] RBAC: Authorizing `identity:get_project(project_id=6241128caa7a4205bcefe609b1398140)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.509214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaad2ea-af73-4f1c-8322-a8c9a85d2a3e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.510863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 591/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/projects/6241128caa7a4205bcefe609b1398140 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:07.516685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.562775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.615845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb97f8-22b1-464e-a628-905e1aa64d68 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.647953 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.648591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.648872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.649143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.649962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=6241128caa7a4205bcefe609b1398140, user.id=7c157e19ef5c4aa08dec4ec116a3c431) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:07.650270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.651701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058af-ac46-46d4-8e40-26cf76441bd7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.657469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 594/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/role_assignments?user.id=7c157e19ef5c4aa08dec4ec116a3c431&scope.project.id=6241128caa7a4205bcefe609b1398140&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:09.607706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7028bc-0d8c-4d2d-8d0e-dbd0ac45db71 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.608203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7028bc-0d8c-4d2d-8d0e-dbd0ac45db71 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.608313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7028bc-0d8c-4d2d-8d0e-dbd0ac45db71 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.609641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 592/1186] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:09.614777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.615223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.615318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.634466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:09.635679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:09.698978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 595/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:09.721211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7028bc-0d8c-4d2d-8d0e-dbd0ac45db71 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:09.776261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:09.820849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7028bc-0d8c-4d2d-8d0e-dbd0ac45db71 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:09.853913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.854687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.854970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.855243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.865856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:09.873511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:09.874589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:32:09.875517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 593/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:09.880491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:09.921374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:09.979989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b0d3-0bf6-4c86-8f2b-a3f7dc7c73d1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:10.013162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:10.014365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:10.014646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:10.014917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:10.015705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:10.016010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:10.017364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:10.025291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 596/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:10.032234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:10.132607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f71e4-c5f0-4314-b1d0-cc21fece9dfb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:10.145953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:10.166025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:10.166893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:10.167202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:10.167513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] PATH_INFO: `/v3/users/7c157e19ef5c4aa08dec4ec116a3c431` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:10.168689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] RBAC: Authorizing `identity:get_user(user_id=7c157e19ef5c4aa08dec4ec116a3c431)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:10.170160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:10.171793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 594/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:32:10 2022] GET /identity/v3/users/7c157e19ef5c4aa08dec4ec116a3c431 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:10.177718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:10.276174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b0cfd-ea59-4590-a555-e966898bb567 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:10.277595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:10.309317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a13f6e-db35-42a7-9627-20d440f44dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:10.310719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a13f6e-db35-42a7-9627-20d440f44dec None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:10.311001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a13f6e-db35-42a7-9627-20d440f44dec None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:10.311277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a13f6e-db35-42a7-9627-20d440f44dec None admin] PATH_INFO: `/v3/projects/6241128caa7a4205bcefe609b1398140` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:10.312475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a13f6e-db35-42a7-9627-20d440f44dec None admin] RBAC: Authorizing `identity:get_project(project_id=6241128caa7a4205bcefe609b1398140)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:10.313898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a13f6e-db35-42a7-9627-20d440f44dec None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:10.315604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 597/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:10 2022] GET /identity/v3/projects/6241128caa7a4205bcefe609b1398140 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:10.321551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:10.422899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1327f6-f591-4877-b3b8-0193df907299 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:10.456021 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b137-6fd9-4549-95c1-2122526977ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:10.456894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b137-6fd9-4549-95c1-2122526977ba None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:10.457171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b137-6fd9-4549-95c1-2122526977ba None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:10.457441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b137-6fd9-4549-95c1-2122526977ba None admin] PATH_INFO: `/v3/projects/6241128caa7a4205bcefe609b1398140/users/7c157e19ef5c4aa08dec4ec116a3c431/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:10.459365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b137-6fd9-4549-95c1-2122526977ba None admin] RBAC: Authorizing `identity:create_grant(project_id=6241128caa7a4205bcefe609b1398140, user_id=7c157e19ef5c4aa08dec4ec116a3c431, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:10.460843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b137-6fd9-4549-95c1-2122526977ba None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:10.472881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 595/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:10 2022] PUT /identity/v3/projects/6241128caa7a4205bcefe609b1398140/users/7c157e19ef5c4aa08dec4ec116a3c431/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:12.420851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084687c3-ab65-44e0-8a4f-63426d9e56a0 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.421399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084687c3-ab65-44e0-8a4f-63426d9e56a0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.421399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084687c3-ab65-44e0-8a4f-63426d9e56a0 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.422782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 598/1193] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:12.427843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.428261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.428409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.448958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:12.450202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:12.485609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:12.517376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 596/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:12.540786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084687c3-ab65-44e0-8a4f-63426d9e56a0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.640339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084687c3-ab65-44e0-8a4f-63426d9e56a0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:12.673088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:12.673812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.674098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.674376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.684945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:12.694758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:12.695912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:32:12.696778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 599/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:12.702141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.797844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113221-d74e-4e8c-b6ca-c47758a9777d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:12.829603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:12.830252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.830533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.830802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.831563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:12.831867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:12.833250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:12.840972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 597/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:12.847104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.876665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:12.944159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4934bb-a83b-40be-accc-385e1c1a5730 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:12.976035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:12.976878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.977154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.977419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] PATH_INFO: `/v3/users/7c157e19ef5c4aa08dec4ec116a3c431` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.978569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] RBAC: Authorizing `identity:get_user(user_id=7c157e19ef5c4aa08dec4ec116a3c431)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:12.980012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:12.981591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 600/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/users/7c157e19ef5c4aa08dec4ec116a3c431 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:12.987710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.025630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.091529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe3491-7779-48d0-a38c-3549d02835f0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.124371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.125015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.125303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.125582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.190430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.191893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.223025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.287545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 598/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:32:13.293369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.385927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.389809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a7b9b-905a-4f13-b98f-c3151558e582 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.423427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6071b6-dc5f-4669-8d71-0f135d660586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.424268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6071b6-dc5f-4669-8d71-0f135d660586 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.424551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6071b6-dc5f-4669-8d71-0f135d660586 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.424824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6071b6-dc5f-4669-8d71-0f135d660586 None admin] PATH_INFO: `/v3/projects/6241128caa7a4205bcefe609b1398140` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.425988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6071b6-dc5f-4669-8d71-0f135d660586 None admin] RBAC: Authorizing `identity:get_project(project_id=6241128caa7a4205bcefe609b1398140)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.427417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6071b6-dc5f-4669-8d71-0f135d660586 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.429075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 601/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:13 2022] GET /identity/v3/projects/6241128caa7a4205bcefe609b1398140 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:13.435007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.529521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011da1-93b4-427c-8f7d-5d9e90eab317 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.562630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.563271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.563581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.563854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.564675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=6241128caa7a4205bcefe609b1398140, user.id=7c157e19ef5c4aa08dec4ec116a3c431) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:13.564983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.566391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18454-1891-406e-9ae4-e02799ce0ce8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.568172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.573118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 599/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:13 2022] GET /identity/v3/role_assignments?user.id=7c157e19ef5c4aa08dec4ec116a3c431&scope.project.id=6241128caa7a4205bcefe609b1398140&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:23.418780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=17 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.571763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.268562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cdefa-e3b2-4cab-be51-032c43fde778 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.269144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cdefa-e3b2-4cab-be51-032c43fde778 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.269144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cdefa-e3b2-4cab-be51-032c43fde778 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.270581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 602/1201] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:08.277469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.278354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.278818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.301112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:08.302438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:08.393978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 600/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:08.421236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cdefa-e3b2-4cab-be51-032c43fde778 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.556896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cdefa-e3b2-4cab-be51-032c43fde778 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.603530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.604447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.604807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.604999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.619431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.619431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:08.644013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:08.645127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:08.646099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:08.646099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:08.646099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:08.646099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:08.651762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.653917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 603/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:08.790395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21645c-81fd-4241-8e08-9fbf10edcfe3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.835107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.847537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.848348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.848626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.848939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.849777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:08.850115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.852007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c4ac-faa5-44e3-ae3a-d3fa899b16cd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.869812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 601/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:08.871205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.934172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:09.004817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c808a-17f6-4ab5-b802-7c058b19f026 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:09.045634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71d230-047a-428c-968a-022cb96fa85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:09.046300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71d230-047a-428c-968a-022cb96fa85b None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:09.046584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71d230-047a-428c-968a-022cb96fa85b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:09.046858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71d230-047a-428c-968a-022cb96fa85b None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:09.047603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71d230-047a-428c-968a-022cb96fa85b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:09.049032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71d230-047a-428c-968a-022cb96fa85b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:09.072573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 604/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Jul 25 08:33:08 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:11.629429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff17f-8ae6-4d4c-abea-eb174f2c3d12 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.630016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff17f-8ae6-4d4c-abea-eb174f2c3d12 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.630118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff17f-8ae6-4d4c-abea-eb174f2c3d12 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.635431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 602/1206] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:11.637327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.637815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.637909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.660957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:11.662155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:11.736970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 605/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:11.762843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff17f-8ae6-4d4c-abea-eb174f2c3d12 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.900895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff17f-8ae6-4d4c-abea-eb174f2c3d12 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.939959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.941210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.941529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.941932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.957500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:11.967931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:11.969154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:11.970113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 603/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:11.976181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:12.024982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:12.102996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956468c8-ebdd-488f-9f9a-e100acf9350d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:12.149289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:12.150106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.150426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.150808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.151738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:12.152044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:12.153609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:12.164924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 606/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:12.170863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:12.227078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:12.292395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89247bf-dbc9-499b-9445-ef59e6a77b9e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:12.345256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:12.346311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.346847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.347222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.363073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:12.365108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:12.390175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:12.391287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:12.392491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:12.392491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:12.392491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:12.392491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:12.397649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 604/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:12.398572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:12.530803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:12.533949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa8fdc-a889-4797-8400-eefc74dfa970 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:12.576702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12868-090f-4785-9143-439969355f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:12.577555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12868-090f-4785-9143-439969355f01 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.577705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12868-090f-4785-9143-439969355f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.577935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12868-090f-4785-9143-439969355f01 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.578752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12868-090f-4785-9143-439969355f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:12.579097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12868-090f-4785-9143-439969355f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:12.580516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12868-090f-4785-9143-439969355f01 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:12.596580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 607/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:12.600740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:12.735024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb55db-2d5e-4636-b587-568e4fa8f092 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:12.736714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:12.777035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:12.778203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.778661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.779649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.788500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:12.789941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:12.807400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:12.808745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:12.809692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 605/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:12.816505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12868-090f-4785-9143-439969355f01 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:12.941488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12868-090f-4785-9143-439969355f01 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:12.983045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:12.983836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.984169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.984501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.985498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:12.985838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:12.987416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.008237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 608/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Jul 25 08:33:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:13.020577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.153410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51834a5-cbca-4c2c-b975-7f016a0e987b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.189166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.189803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.190079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.190346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.226130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.276751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.278253 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.407723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 606/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:13.413037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.432158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.522878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6e26-0f0c-4082-a770-404da111c6dd None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.561973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.562768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.563051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.563329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.574599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.576750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:13.595317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:13.596465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:13.597637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:13.597637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:13.597637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:13.597637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:13.597637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 609/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:13.602434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.675195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.715088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8afd-885c-46c2-8ddc-0fdaab4186c5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.752678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.754058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.754497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.754923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.755917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:13.756386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.757917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.771008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 607/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:13.777538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.852079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.885832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24c556-2c11-4ac8-9930-cd625a7fde89 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.925031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.925996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.926229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.926512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.934751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.937019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:13.951505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:13.952677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:13.953575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 610/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:13.958541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:14.083185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa962-dc2b-451c-8bd5-dae6be53fbc8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:14.111368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:14.125971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.126637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.126918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.127192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.128017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:14.128329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.129773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee74a-38a5-4f96-aac5-a4ca28b71306 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.142596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 608/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:14.148796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:14.272171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b4ad-db69-42ed-af1c-2afdfc9f12f6 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:14.304235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:14.311437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.312093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.312377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.312654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.313487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6cc0a416829f433f8cd3867cde7214bc) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:14.313802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.315229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21376-93a0-478e-b66a-3e02d1a1e391 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.321130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 611/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:14 2022] GET /identity/v3/role_assignments?user.id=6cc0a416829f433f8cd3867cde7214bc&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:16.522461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889e46-910d-4eba-a7aa-899020ebfa52 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.523036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889e46-910d-4eba-a7aa-899020ebfa52 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.523036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889e46-910d-4eba-a7aa-899020ebfa52 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.524620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 609/1220] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:16.529705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.530109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.530287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.549686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:16.550649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:16.628704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 612/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:16.652003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889e46-910d-4eba-a7aa-899020ebfa52 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:16.773740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889e46-910d-4eba-a7aa-899020ebfa52 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:16.812563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:16.813444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.813732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.814010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.825513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:16.833355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:16.834320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:16.835264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 610/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:33:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:16.841866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:16.953972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126114ba-2b84-464b-b3fd-f3044e3b22aa None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:16.980325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:16.992211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:16.992886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.993175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.993452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.994208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] RBAC: Adding query filter params (name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:16.994517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:16.995953 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.004560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 613/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:33:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:17.010836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.059199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.127266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bf1b1-54d3-45f4-b3b5-e39a61b2cfab None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.169539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.170870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.171147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.171448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.184687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.186740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:17.205057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:17.206215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:17.207460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:17.207460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:17.207460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:17.207460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:17.207460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 611/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:17.213563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.338729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40c5d2-18e4-4b5d-8e56-04b5fdcb4768 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.378090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.378911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.379163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.379475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.380311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:17.380655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.382142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.401114 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 614/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:17.402518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.510118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.517880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20dcaf-40c1-4ae5-8507-02a5ffa617df None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.556614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.557477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.557769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.558047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.567476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.569077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:17.585992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:17.587080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:17.588041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 612/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:17.593849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.646281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.708207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a258ae8-02de-4727-a9b1-2e23c476c56c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.745806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.746798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.747035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.747414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.748946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:17.749300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.751003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.771281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 615/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:17.777115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.884207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce208b48-15eb-49bf-965b-6fc5496d8039 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.920060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.921051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.921335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.921627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.933492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.935237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:17.954763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:17.955912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:17.956994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:17.956994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:17.956994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:17.956994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:17.959709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 613/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:17.962079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.064181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174b36-da72-4696-8f14-299fb8bd46b7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.066674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.104903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309310-4c52-4be8-919c-30771d28911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.105728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309310-4c52-4be8-919c-30771d28911d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.106133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309310-4c52-4be8-919c-30771d28911d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.106550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309310-4c52-4be8-919c-30771d28911d None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.108042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309310-4c52-4be8-919c-30771d28911d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.108357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309310-4c52-4be8-919c-30771d28911d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.110969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309310-4c52-4be8-919c-30771d28911d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.124383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 616/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:18.130410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.140678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.239753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f816-bed5-4dd3-919e-28fbfe9b04ad None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.282812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.283847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.284020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.284386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.293974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.296195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:18.311759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:18.312923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:18.314315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 614/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:18.319469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309310-4c52-4be8-919c-30771d28911d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.428274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309310-4c52-4be8-919c-30771d28911d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.465808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.466508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.467337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.467643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.468449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.468800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.470446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45187-2459-406b-ad66-9565fd12f6e9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.484398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 617/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:18.491199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.560127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.596021 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13421-fff6-4127-b918-073eedd2243c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.632333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535177e5-1121-485f-b291-20799729ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.633250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535177e5-1121-485f-b291-20799729ece9 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.633533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535177e5-1121-485f-b291-20799729ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.633809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535177e5-1121-485f-b291-20799729ece9 None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6cc0a416829f433f8cd3867cde7214bc/roles/c1fd8fc71db049f3804680e7cbf5418a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.650234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535177e5-1121-485f-b291-20799729ece9 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=6cc0a416829f433f8cd3867cde7214bc, role_id=c1fd8fc71db049f3804680e7cbf5418a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.651726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535177e5-1121-485f-b291-20799729ece9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.664207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 615/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:18 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6cc0a416829f433f8cd3867cde7214bc/roles/c1fd8fc71db049f3804680e7cbf5418a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:33:20.799040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa100-d2fc-4414-ba09-000760036169 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:20.799580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa100-d2fc-4414-ba09-000760036169 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:20.799580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa100-d2fc-4414-ba09-000760036169 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:20.800964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 618/1233] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:20.806292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:20.806741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:20.806835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:20.832591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:20.833789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:20.905825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 616/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:20.929336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa100-d2fc-4414-ba09-000760036169 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:20.955236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.037929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa100-d2fc-4414-ba09-000760036169 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.080048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.080882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.081189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.081504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.095001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:21.103853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:21.105078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:21.108389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 619/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Jul 25 08:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:21.111525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.159281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.215642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48015-22fd-4d99-a767-0c76a185ac7d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.255611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.256343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.256633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.256906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.257650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.257954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.259322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.271418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 617/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:21.273877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.372260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.387807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec526ad-6941-41b7-8399-c069e0202cf2 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.422134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.422924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.423209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.423524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.435380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.436860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:21.457247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:21.458201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:21.459090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:21.459090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:21.459090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:21.459090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:21.459090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 620/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:21.464277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.571152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e102911-a3c7-4b9f-9632-44aaf238a9b6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.580875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.606196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.606845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.607145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.607448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.608176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.608519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.609838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.621827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 618/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:21.628598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.732635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd92cb-2452-4296-b36e-3707e6766ca4 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.768568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.769493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.769779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.770053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.772742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.778607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.780176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:21.794626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:21.796669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:21.797803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:21.799531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 621/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:21.801637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.912197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118acc6-1b0d-42cd-810c-0502e855662d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.953878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.954733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.955218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.955684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.956546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.957313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.958733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.979503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 619/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:21.985974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.111787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d701c-df38-4bb3-a004-332e3447a791 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.150931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.151601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.151885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.152187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.222666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.230550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.233180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.351994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 622/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:22.353287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.383088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.463573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b024bb-900c-4125-aef3-4004551fb52f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.499051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.499833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.500119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.500397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.510314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.511932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:22.530486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:22.531741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:22.532820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:22.532820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:22.532820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:22.532820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:22.532820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 620/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:22.537752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.642607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.649495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a5dbf-6762-4835-aa99-41035197a1fa None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.687586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040377-a281-4929-8095-59b42200617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.688338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040377-a281-4929-8095-59b42200617c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.688627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040377-a281-4929-8095-59b42200617c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.688907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040377-a281-4929-8095-59b42200617c None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.689658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32040377-a281-4929-8095-59b42200617c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:22.689941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32040377-a281-4929-8095-59b42200617c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.691468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32040377-a281-4929-8095-59b42200617c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.704550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 623/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:22.710177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.797728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.823131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32fd3e-d2b0-481c-8a39-7c72ba9dbf16 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.862129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.862926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.863209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.863522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.870620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.873144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:22.887132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:22.888284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:22.890311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 621/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:22.894979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040377-a281-4929-8095-59b42200617c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:23.004839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040377-a281-4929-8095-59b42200617c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:23.039374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:23.040534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.040534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.040739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.041366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:23.041663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:23.043102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4891e-734d-47ec-be98-841bf3a760a0 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:23.056252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 624/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:23.062739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:23.169656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96b581-9408-4aef-ad50-b5368f198676 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:23.208858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:23.209518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.209806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.210084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.210923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] RBAC: Adding query filter params (role.id=c1fd8fc71db049f3804680e7cbf5418a, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6cc0a416829f433f8cd3867cde7214bc) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:23.211236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:23.212708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb44a-acdc-4ffe-96d1-a2307f63e4dc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:23.219700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 622/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:23 2022] GET /identity/v3/role_assignments?user.id=6cc0a416829f433f8cd3867cde7214bc&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=c1fd8fc71db049f3804680e7cbf5418a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:25.436911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ade2-8680-4527-90ea-43e6d505471f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.437520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ade2-8680-4527-90ea-43e6d505471f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.437520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ade2-8680-4527-90ea-43e6d505471f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.439371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 625/1247] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:25.444609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.445053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.445166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.452504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.464930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:25.466134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:25.551433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 623/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:25.573540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ade2-8680-4527-90ea-43e6d505471f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.594650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.688240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ade2-8680-4527-90ea-43e6d505471f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.728652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.729606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.730092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.730409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.744315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:25.752644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:25.753722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:25.754652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 626/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:25.760492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.872676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8005ff3-8b8a-475c-8fd1-f155ea1c9b9f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.904820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.910119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.911002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.911495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.911773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.912534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:25.912842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:25.914225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:25.927678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 624/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:25.928845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.012452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.037534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8aa1-df17-46a0-b4f4-ec255a4ed3f7 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.078599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.079449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.079737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.080013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.091038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.093453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:26.114665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:26.116195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:26.118216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:26.118216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:26.118216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:26.118216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:26.118216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 627/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:26.122218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.244530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff442d7-c753-45df-8f18-e225533eb3cf None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.284087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.284881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.285175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.285458 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.286428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:26.286864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.288791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.304209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 625/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:26.310221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.423130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50606bf4-fd44-4cb5-93f3-ac4816b8ca23 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.450251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.459642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.460407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.460694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.460959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.469364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.470800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:26.486292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:26.487593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:26.488552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 628/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:26.494795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.565544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.614941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945995c-465e-4da9-88f0-6f15566edefc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.653757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.654989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.655277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.655607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.656449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:26.656887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.658420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.678366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 626/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:26.684135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.791532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9037-c0e1-4f24-acab-b63b2472953e None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.830722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.831425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.831601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.831872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.895122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.910783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.912355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.017734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 629/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:33:27.023453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.134739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a10cd1-5ca9-4481-a50d-7d9daba938fd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.149097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.175351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.176170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.176447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.176716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.187589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.189041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:27.209778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:27.210895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:27.212056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:27.212056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:27.212056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:27.212056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:27.212056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 627/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:27.218420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.320452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.335687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306bb5-da35-47ac-a6f8-15558e6616bc None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.379466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccf556-063b-437e-969d-332763333489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.380365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccf556-063b-437e-969d-332763333489 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.380771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccf556-063b-437e-969d-332763333489 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.381230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccf556-063b-437e-969d-332763333489 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.382090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccf556-063b-437e-969d-332763333489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:27.382516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccf556-063b-437e-969d-332763333489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.384083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccf556-063b-437e-969d-332763333489 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.398489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 630/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:27.405587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.516791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cfe8-4b34-4780-ac5e-5a29df21ac57 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.559506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.560901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.561190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.561465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.569948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.571486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:27.586528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:27.587707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:27.588729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 628/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:27.594048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccf556-063b-437e-969d-332763333489 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.701581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccf556-063b-437e-969d-332763333489 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.737171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.737849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.738135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.738411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.739218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:27.739571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.741035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62715c8b-64fd-40ff-8b29-3a7e1cf8da6b None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.755025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 631/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:27.761269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.787856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.868143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5fb76-9f23-495d-b943-4d2175a9589c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.903326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.904556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.904839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.905118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.905963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6cc0a416829f433f8cd3867cde7214bc) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:27.906280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.907760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c4d7-c2ad-4b5d-87f4-14de88ef137c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.913795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 629/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/role_assignments?user.id=6cc0a416829f433f8cd3867cde7214bc&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:29.899628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5deb79-78d1-4152-a219-3b236000a80e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:29.900137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5deb79-78d1-4152-a219-3b236000a80e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:29.900137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5deb79-78d1-4152-a219-3b236000a80e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:29.901492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 632/1261] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:29.906818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:29.907212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:29.907367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:29.926269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:29.927476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:29.991363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 630/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:30.014012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5deb79-78d1-4152-a219-3b236000a80e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:30.024606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:30.113188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5deb79-78d1-4152-a219-3b236000a80e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:30.145036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:30.145807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:30.146090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:30.146364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:30.156972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:30.164597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:30.165659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:30.166667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 633/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:30.172172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:30.189595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:30.267817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e99df-6bdd-47ac-bd5e-7b421d2e8965 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:30.302055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:30.302699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:30.302994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:30.303262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:30.304019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:30.304327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:30.305718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:30.315167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 631/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:30.321008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:30.388144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:30.421478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e819-43c4-4190-9c96-b74a1b45235b None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:30.452643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:30.453414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:30.453721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:30.453993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:30.464074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:30.465491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:30.483261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:30.484318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:30.485519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:30.485519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:30.485519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:30.485519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:30.485519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 634/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:30.490149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:30.569181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:30.588409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db0f19-6461-4b75-81c9-8b3d2fd118d5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:30.620741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:30.621385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:30.621666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:30.621939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:30.622656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:30.622957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:30.624336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:30.635615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 632/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:30.641695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:30.737040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04208b2-f5fb-4ebe-8f1e-ddf4749014e1 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:30.755379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:30.769924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:30.770706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:30.770985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:30.771254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:30.778465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:30.780559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:30.794442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:30.795545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:30.796688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 635/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:30.801239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:30.899546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c6ab-9fe6-4d45-ac06-ebae0313cc27 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:30.935010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:30.936202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:30.936490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:30.936764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:30.937597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:30.937908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:30.939344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:30.948004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:30.957287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 633/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:30.962934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.062805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25e4ae-826a-45db-9cf5-a0fdfdb30802 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.095174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.095982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.096271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.096546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.107083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.108561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:31.125787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:31.126787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:31.127895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:31.127895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:31.127895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:31.127895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:31.127895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 636/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:31.132615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.228316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9264d9-ce72-4d81-9a8d-71e63a537c15 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.262977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.263664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.263949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.264228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.264948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:31.265252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.266615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.277626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 634/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:31.283415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.322063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.388165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086632ac-244a-4c22-8f29-81aacb842879 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.419997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.420792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.421075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.421347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.427806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.429235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:31.443803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:31.444866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:31.446129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 637/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:31.450759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.508861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.548797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc857e24-c1f4-43c3-9ea2-811f4307728e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.581244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.581838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.582118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.582389 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.583165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:31.583498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.584929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483c197-2b7c-46ed-ade4-9729c8369e4c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.596967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 635/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:31.603289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.691695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.701203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427f5f-a43e-44ca-ae51-aa15e2923404 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.735732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2388d2-1298-4f28-8e1e-dd002a1205f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.736610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2388d2-1298-4f28-8e1e-dd002a1205f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.736893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2388d2-1298-4f28-8e1e-dd002a1205f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.737165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2388d2-1298-4f28-8e1e-dd002a1205f3 None admin] PATH_INFO: `/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6cc0a416829f433f8cd3867cde7214bc/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.739108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2388d2-1298-4f28-8e1e-dd002a1205f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa5b4df14d4eb0b0404522558b4e76, user_id=6cc0a416829f433f8cd3867cde7214bc, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.740571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2388d2-1298-4f28-8e1e-dd002a1205f3 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.752724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 638/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:31 2022] PUT /identity/v3/projects/dafa5b4df14d4eb0b0404522558b4e76/users/6cc0a416829f433f8cd3867cde7214bc/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:33:33.688620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9622d-c540-4f86-be21-51d7eba5747d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:33.689120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9622d-c540-4f86-be21-51d7eba5747d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:33.689212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9622d-c540-4f86-be21-51d7eba5747d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:33.690529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 636/1274] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:33.695814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:33.696179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:33.696369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:33.713991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:33.715170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:33.779280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 639/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:33.802568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9622d-c540-4f86-be21-51d7eba5747d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:33.900289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9622d-c540-4f86-be21-51d7eba5747d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:33.917213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:33.934518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:33.935308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:33.935633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:33.935909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:33.945868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:33.953471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:33.954560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:33.955606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 637/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:33.960725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.038571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.057138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044568c-dc7e-48c3-bcbd-ae19aa686cd9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.089119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.089775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.090056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.090330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.091075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:34.091912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.093290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.101346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 640/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:34.106839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.203697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfaf6-299a-4226-ab53-b72d84207aed None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.236807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.237577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.237858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.238130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.248494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.249942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:34.267032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:34.268097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:34.269202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:34.269202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:34.269202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:34.269202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:34.269202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 638/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:34.273932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.370968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb831-4f03-46b1-99ba-ee5809a4a143 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.403028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.403704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.404544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.404823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.405541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:34.405845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.407199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.418529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 641/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:34.424005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.454073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.520633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526f38-d69d-486c-a091-e979a2326480 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.555128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.555970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.556251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.556522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.564135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.565565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:34.580029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:34.581125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:34.582279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 639/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:34.586905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.590611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.683830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029368f3-0bda-4e1f-98e5-1f4823346ba8 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.716845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.717499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.717783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.718060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.718882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:34.719191 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.720643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.737318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 642/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:34.742874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.832261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.841822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14bee9-d2d4-46c9-b6f8-950e3c9eac14 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.874372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.875004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.875287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.875594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.943454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.944860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:35.033483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:35.043774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 640/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:33:35.050019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:35.109109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:35.146324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ac67-64a1-4593-b2bb-4869d1869b21 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:35.179402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70e301-b112-4703-b996-3f973036397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:35.180183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70e301-b112-4703-b996-3f973036397c None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:35.180465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70e301-b112-4703-b996-3f973036397c None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:35.180734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70e301-b112-4703-b996-3f973036397c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:35.190957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70e301-b112-4703-b996-3f973036397c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:35.192424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70e301-b112-4703-b996-3f973036397c None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-ea70e301-b112-4703-b996-3f973036397c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:35.209558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:35.210593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:35.211685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:35.211685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:35.211685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:35.211685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:35.211685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 643/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:35.216240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:35.311719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3b62-b8d7-413d-a63b-5441b908f752 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:35.344411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:35.345054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:35.345335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:35.345607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:35.346315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:35.346617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:35.348002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:35.359659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 641/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:35.365004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70e301-b112-4703-b996-3f973036397c None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:35.464577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70e301-b112-4703-b996-3f973036397c None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:35.478648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:35.498771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:35.499578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:35.499865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:35.500138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:35.506625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:35.508087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:35.521604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:35.522651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: ERROR keystone.server.flask.application Jul 25 08:33:35.523621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 644/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:35.528510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:35.578129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:35.628019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95f7f1-cda2-4467-aab0-788968b8cf52 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:35.660674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:35.661324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:35.661612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:35.661893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:35.662680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:35.662994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:35.664458 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08fcc6-d2bf-4c9a-a486-6b371f634772 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:35.676766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 642/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:35.682727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:35.779833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b693b-4c49-4130-9b53-f7302f3e9b5d None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:35.811366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:35.812025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:35.812311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:35.812586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:35.813410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] RBAC: Adding query filter params (role.id=cb54b7b6fc064ff6aed21ebbbcf57b60, scope.project.id=dafa5b4df14d4eb0b0404522558b4e76, user.id=6cc0a416829f433f8cd3867cde7214bc) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:35.813721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:35.815134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac939b0-2c1a-4b00-80d7-5beb93d1a83a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:35.820810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 645/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:35 2022] GET /identity/v3/role_assignments?user.id=6cc0a416829f433f8cd3867cde7214bc&scope.project.id=dafa5b4df14d4eb0b0404522558b4e76&role.id=cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:37.811529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d37f3-c2c2-461a-87ba-115c09370d57 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.812078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d37f3-c2c2-461a-87ba-115c09370d57 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.812078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d37f3-c2c2-461a-87ba-115c09370d57 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.813371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 643/1288] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:37.818516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162727-7450-4854-a086-6df918d679a7 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.818949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162727-7450-4854-a086-6df918d679a7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.819070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162727-7450-4854-a086-6df918d679a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.837322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-73162727-7450-4854-a086-6df918d679a7 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:37.838487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-73162727-7450-4854-a086-6df918d679a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:37.866620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:37.903991 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 646/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:37.924947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d37f3-c2c2-461a-87ba-115c09370d57 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:38.024941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d37f3-c2c2-461a-87ba-115c09370d57 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:38.035223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:38.058983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:38.059804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:38.060090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:38.060917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:38.061626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:38.062946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:38.074700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:38.076119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:38.077364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 644/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:33:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:38.081895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73162727-7450-4854-a086-6df918d679a7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:38.175542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73162727-7450-4854-a086-6df918d679a7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:38.207749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:38.208389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:38.208669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:38.208939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:38.209628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:38.209930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:38.211271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712389a7-527b-4cc9-b9c0-4895016b1cd9 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:38.215949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 647/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Jul 25 08:33:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:38.221350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:38.326926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86c5f-a24c-4045-b298-b1bd808b50e8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:38.362858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:38.363554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:38.363840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:38.364117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:38.364819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:38.365153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:38.366534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faa217-e783-4a71-9e0a-7f2e087c363f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:38.370897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 645/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Jul 25 08:33:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:40.308241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295f4b-8434-4586-8fd6-16652c7df8bc None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:40.308794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295f4b-8434-4586-8fd6-16652c7df8bc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:40.308794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295f4b-8434-4586-8fd6-16652c7df8bc None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:40.310159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 648/1293] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:40.315268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae95ee-76a0-4b82-b886-09dc33f38c39 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:40.315714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae95ee-76a0-4b82-b886-09dc33f38c39 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:40.315853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae95ee-76a0-4b82-b886-09dc33f38c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:40.334069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-38ae95ee-76a0-4b82-b886-09dc33f38c39 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:40.335248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-38ae95ee-76a0-4b82-b886-09dc33f38c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:40.364706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:40.401426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 646/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:40.423265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295f4b-8434-4586-8fd6-16652c7df8bc None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:40.453945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:40.522043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295f4b-8434-4586-8fd6-16652c7df8bc None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:40.560249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3616-fa6a-4eed-920a-1ba182ef5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:40.560856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3616-fa6a-4eed-920a-1ba182ef5d42 None admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:40.561146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3616-fa6a-4eed-920a-1ba182ef5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:40.561429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3616-fa6a-4eed-920a-1ba182ef5d42 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:40.562151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3616-fa6a-4eed-920a-1ba182ef5d42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:40.563555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3616-fa6a-4eed-920a-1ba182ef5d42 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:40.577985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 649/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Jul 25 08:33:40 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:42.556665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6d6c3-d2f9-4bdc-96d6-1cd0d5e0b388 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.557110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6d6c3-d2f9-4bdc-96d6-1cd0d5e0b388 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.557208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6d6c3-d2f9-4bdc-96d6-1cd0d5e0b388 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.558582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 647/1296] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:42.564185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.564567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.564748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.583005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:42.584218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:42.653935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 650/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:42.675983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6d6c3-d2f9-4bdc-96d6-1cd0d5e0b388 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:42.774142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6d6c3-d2f9-4bdc-96d6-1cd0d5e0b388 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:42.806801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:42.807560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.807840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.808113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.808769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:42.810674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:42.822394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:42.823578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:42.824759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 648/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:33:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:42.829458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:42.847595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:42.926592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fd53b-9787-4b8d-b97b-6d37e3772b83 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:42.958528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:42.959176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.959486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.959770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.960469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:42.960776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:42.962132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:42.967673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 651/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Jul 25 08:33:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:42.973534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:43.005204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:43.075635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9894a2-ed0a-43a0-b8da-11bf9e4c0360 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:43.108674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:43.109322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:43.109608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:43.109885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:43.110677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] RBAC: Adding query filter params (interface=public, service_id=47b6239db86b455db0c684594f601ccb, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:43.110988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:43.112383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646aac8-07ee-4b31-9e5c-7d973597bb65 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:43.117275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 649/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Jul 25 08:33:42 2022] GET /identity/v3/endpoints?service_id=47b6239db86b455db0c684594f601ccb&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:43.122995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:43.201054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:43.218985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a592d-9310-4622-92af-8527d084bb63 None admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:43.251741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e805aa-7f2c-46d4-aec0-d7faa6b9c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:43.252390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e805aa-7f2c-46d4-aec0-d7faa6b9c747 None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:43.252704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e805aa-7f2c-46d4-aec0-d7faa6b9c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:43.252986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e805aa-7f2c-46d4-aec0-d7faa6b9c747 None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:43.253658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e805aa-7f2c-46d4-aec0-d7faa6b9c747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:43.255019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e805aa-7f2c-46d4-aec0-d7faa6b9c747 None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:43.261743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 652/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Jul 25 08:33:43 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:33:45.255135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453b989-d845-4e5c-9027-ecd39927d94f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.255704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453b989-d845-4e5c-9027-ecd39927d94f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.255704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453b989-d845-4e5c-9027-ecd39927d94f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.257100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 650/1302] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:45.262250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d256d-080f-471d-a490-9a47939df698 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.262654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d256d-080f-471d-a490-9a47939df698 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.262815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d256d-080f-471d-a490-9a47939df698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.281006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d57d256d-080f-471d-a490-9a47939df698 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:45.282184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d57d256d-080f-471d-a490-9a47939df698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:45.363334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 653/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:45.387406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453b989-d845-4e5c-9027-ecd39927d94f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.479887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.487086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453b989-d845-4e5c-9027-ecd39927d94f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.519369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.520125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.520402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.520673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.521316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.522676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:45.534291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:45.535518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: ERROR keystone.server.flask.application Jul 25 08:33:45.536434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 651/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:45.541620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d256d-080f-471d-a490-9a47939df698 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.616728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.640086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d256d-080f-471d-a490-9a47939df698 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.672961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.673619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.673906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.674184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] PATH_INFO: `/v3/services` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.674888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:45.675195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.676614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ceaaf-5d32-424b-98c4-fd6c311eae6a None admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.681665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 654/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:45.687475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.784422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab03bc7-4874-4782-a423-e0e4fa1a6991 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.816395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb50f9-816b-4681-a0e6-51addcfccd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.817033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb50f9-816b-4681-a0e6-51addcfccd5c None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.817313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb50f9-816b-4681-a0e6-51addcfccd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.817585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb50f9-816b-4681-a0e6-51addcfccd5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.818325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb50f9-816b-4681-a0e6-51addcfccd5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.819708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb50f9-816b-4681-a0e6-51addcfccd5c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.838794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 652/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:33:55.678650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=30 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:55.834670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:47.969313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24d2-e947-4c66-98f4-0486f92ad065 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:47.969907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24d2-e947-4c66-98f4-0486f92ad065 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:47.969907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24d2-e947-4c66-98f4-0486f92ad065 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:47.974965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 655/1307] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:34:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:47.976343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c7d7-ff4c-4e7a-b81a-de49860de586 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:47.976786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c7d7-ff4c-4e7a-b81a-de49860de586 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:47.976912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c7d7-ff4c-4e7a-b81a-de49860de586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:48.059814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bcc7c7d7-ff4c-4e7a-b81a-de49860de586 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:48.061401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bcc7c7d7-ff4c-4e7a-b81a-de49860de586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:48.224040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 653/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:34:48.261481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17568852-f870-4bd0-abe5-06520a2c5d02 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:48.261769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17568852-f870-4bd0-abe5-06520a2c5d02 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:48.262062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17568852-f870-4bd0-abe5-06520a2c5d02 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:48.263611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 656/1309] 10.222.0.57 () {54 vars in 965 bytes} [Mon Jul 25 08:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:48.277452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cb5e-66aa-4e4d-8a5c-cd43b7ed1f86 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:48.277973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cb5e-66aa-4e4d-8a5c-cd43b7ed1f86 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:48.278449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cb5e-66aa-4e4d-8a5c-cd43b7ed1f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:48.402093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2ca6cb5e-66aa-4e4d-8a5c-cd43b7ed1f86 None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:48.403425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2ca6cb5e-66aa-4e4d-8a5c-cd43b7ed1f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:48.425979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:48.487029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 654/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Mon Jul 25 08:34:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:34:48.496514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17568852-f870-4bd0-abe5-06520a2c5d02 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:48.498360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-17568852-f870-4bd0-abe5-06520a2c5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:48.625687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17568852-f870-4bd0-abe5-06520a2c5d02 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:48.703988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:48.704642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:48.704926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:48.705200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:48.706841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:48.763146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:48.822705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:48.824208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07173a-1266-436c-8e45-ea91e8155cb7 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:48.845144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 657/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:34:51.145513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aadc8-3eff-433e-b023-fc867b1db899 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:51.146028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aadc8-3eff-433e-b023-fc867b1db899 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:51.146028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aadc8-3eff-433e-b023-fc867b1db899 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:51.147516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 655/1312] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:51.152506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534fec-b273-44c7-8ea4-dd77145d3112 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:51.152895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534fec-b273-44c7-8ea4-dd77145d3112 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:51.153074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534fec-b273-44c7-8ea4-dd77145d3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:51.236515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8d534fec-b273-44c7-8ea4-dd77145d3112 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:51.237742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8d534fec-b273-44c7-8ea4-dd77145d3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:51.341231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 658/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:34:51.379792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aadc8-3eff-433e-b023-fc867b1db899 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:51.381528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-603aadc8-3eff-433e-b023-fc867b1db899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:51.499340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aadc8-3eff-433e-b023-fc867b1db899 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:51.590664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:51.593697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:51.594419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:51.594701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:51.594973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:51.597323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:51.725479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:51.726923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce38db8-f553-40e2-87c6-cfde3d77340c service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:51.746250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 656/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:34:54.030721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf1e7-ab9f-43ed-bcf2-f9c7d70ab839 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:54.031822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf1e7-ab9f-43ed-bcf2-f9c7d70ab839 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:54.031915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf1e7-ab9f-43ed-bcf2-f9c7d70ab839 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:54.033295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 659/1315] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:54.038656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17fa12-d340-4d83-9f80-ac683608d6ac None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:54.039077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17fa12-d340-4d83-9f80-ac683608d6ac None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:54.039227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17fa12-d340-4d83-9f80-ac683608d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:54.104257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3e17fa12-d340-4d83-9f80-ac683608d6ac None None] MFA Rules not processed for user `cdc4137cd0c846d48612f811124960c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:54.105466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3e17fa12-d340-4d83-9f80-ac683608d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:54.155945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:54.201270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 657/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:34:54.256246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d2a8-cd0a-4cf2-a533-4ae887e921d0 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:54.256532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d2a8-cd0a-4cf2-a533-4ae887e921d0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:54.256808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d2a8-cd0a-4cf2-a533-4ae887e921d0 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:54.258211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 660/1317] 10.222.0.57 () {54 vars in 965 bytes} [Mon Jul 25 08:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:54.264125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dfcf1-b618-41f8-b464-e512115f3e2a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:54.264417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dfcf1-b618-41f8-b464-e512115f3e2a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:54.264691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dfcf1-b618-41f8-b464-e512115f3e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:54.340411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bd4dfcf1-b618-41f8-b464-e512115f3e2a None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:54.341612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bd4dfcf1-b618-41f8-b464-e512115f3e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:54.414750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 658/1318] 10.222.0.57 () {58 vars in 1062 bytes} [Mon Jul 25 08:34:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:34:54.424192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d2a8-cd0a-4cf2-a533-4ae887e921d0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:54.425720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ad56d2a8-cd0a-4cf2-a533-4ae887e921d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:54.435416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:54.528927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d2a8-cd0a-4cf2-a533-4ae887e921d0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:54.600647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:54.601290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:54.601574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:54.601850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:54.603774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:54.663883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:54.711085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:54.712479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dce74-dca0-47d5-bb24-1b3cefb23ed5 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:54.730526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 661/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:34:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:34:57.696112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c762-eaa9-4c4f-9102-6c59882dc34b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:57.696636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c762-eaa9-4c4f-9102-6c59882dc34b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:57.696636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c762-eaa9-4c4f-9102-6c59882dc34b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:57.698035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 659/1320] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:57.703103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f32db-471e-47b6-91b8-14f9db8ebbf4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:57.703501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f32db-471e-47b6-91b8-14f9db8ebbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:57.703704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f32db-471e-47b6-91b8-14f9db8ebbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:57.769096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3f4f32db-471e-47b6-91b8-14f9db8ebbf4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:57.770298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3f4f32db-471e-47b6-91b8-14f9db8ebbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:57.865082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 662/1321] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:34:57.902523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c762-eaa9-4c4f-9102-6c59882dc34b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:57.904085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4da6c762-eaa9-4c4f-9102-6c59882dc34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:57.953567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:58.007340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c762-eaa9-4c4f-9102-6c59882dc34b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:58.079879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:58.080517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:58.080796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:58.081069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:58.082689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:58.176787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:58.190059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:58.191530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad33a-c936-4859-837b-f4c8995d471e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:58.209813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 660/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:34:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:00.891898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a543-1cbb-4d16-a722-acd7b64f116a None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:00.892401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a543-1cbb-4d16-a722-acd7b64f116a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:00.892401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a543-1cbb-4d16-a722-acd7b64f116a None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:00.893879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 663/1323] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:00.899103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd84e-0182-475b-8947-a545eb58fd80 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:00.899544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd84e-0182-475b-8947-a545eb58fd80 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:00.899695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd84e-0182-475b-8947-a545eb58fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:00.967066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7becd84e-0182-475b-8947-a545eb58fd80 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:00.968868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7becd84e-0182-475b-8947-a545eb58fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:01.072770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 661/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:01.110510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075a543-1cbb-4d16-a722-acd7b64f116a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:01.112102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4075a543-1cbb-4d16-a722-acd7b64f116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:01.132537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:01.222475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075a543-1cbb-4d16-a722-acd7b64f116a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:01.295094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:01.295878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:01.296444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:01.296707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:01.298441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:01.372650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:01.411117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:01.412636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78694d69-96ce-4f12-8b90-7d35046d98e7 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:01.430962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 664/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:03.477965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20a9b-27ba-4152-b30d-037fb4ae43b3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:03.478476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20a9b-27ba-4152-b30d-037fb4ae43b3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:03.478476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20a9b-27ba-4152-b30d-037fb4ae43b3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:03.479946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 662/1326] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:03.484989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd013-d864-4b66-b4cc-fbcca3b74c00 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:03.485373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd013-d864-4b66-b4cc-fbcca3b74c00 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:03.485549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd013-d864-4b66-b4cc-fbcca3b74c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:03.553096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-88ccd013-d864-4b66-b4cc-fbcca3b74c00 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:03.554319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-88ccd013-d864-4b66-b4cc-fbcca3b74c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:03.648813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 665/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:03.684555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20a9b-27ba-4152-b30d-037fb4ae43b3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:03.686105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f2f20a9b-27ba-4152-b30d-037fb4ae43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:03.749532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:03.795003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20a9b-27ba-4152-b30d-037fb4ae43b3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:03.872422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:03.873070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:03.873351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:03.873624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:03.875988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:03.991168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:03.993698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:03.995567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881041b1-f5ff-4241-8f57-c6848b444d15 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:04.014141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 663/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:06.076249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283ae5-ad39-4616-8f72-0d0d7bd82043 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:06.076816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283ae5-ad39-4616-8f72-0d0d7bd82043 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:06.076816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283ae5-ad39-4616-8f72-0d0d7bd82043 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:06.078757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 666/1329] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:06.083903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e80d8-1856-4759-87b1-f3435ecabedd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:06.084330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e80d8-1856-4759-87b1-f3435ecabedd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:06.084465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e80d8-1856-4759-87b1-f3435ecabedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:06.150214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-239e80d8-1856-4759-87b1-f3435ecabedd None None] MFA Rules not processed for user `cdc4137cd0c846d48612f811124960c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:06.151340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-239e80d8-1856-4759-87b1-f3435ecabedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:06.250062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 664/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:06.287879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70283ae5-ad39-4616-8f72-0d0d7bd82043 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:06.289554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-70283ae5-ad39-4616-8f72-0d0d7bd82043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:06.320649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:06.394555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70283ae5-ad39-4616-8f72-0d0d7bd82043 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:06.465819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:06.466378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:06.466659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:06.466933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:06.468626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:06.549777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:06.582496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:06.583975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fd585-fdd9-44dd-83e9-af461fb1619a service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:06.601928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 667/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:08.857832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdf44-8d78-46e0-8cc0-f0124d2a3433 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:08.858332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdf44-8d78-46e0-8cc0-f0124d2a3433 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:08.858449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdf44-8d78-46e0-8cc0-f0124d2a3433 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:08.859827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 665/1332] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:08.864977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8b0e-0b60-46f9-84a9-74293e14da26 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:08.865379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8b0e-0b60-46f9-84a9-74293e14da26 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:08.865533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8b0e-0b60-46f9-84a9-74293e14da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:08.929847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-074f8b0e-0b60-46f9-84a9-74293e14da26 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:08.931052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-074f8b0e-0b60-46f9-84a9-74293e14da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:09.028804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 668/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:09.065030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdf44-8d78-46e0-8cc0-f0124d2a3433 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:09.066564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bf3fdf44-8d78-46e0-8cc0-f0124d2a3433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:09.135929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:09.173192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdf44-8d78-46e0-8cc0-f0124d2a3433 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:09.244620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:09.245262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:09.245546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:09.245820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:09.247473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:09.354423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:09.355896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a451eb-43b3-4d57-98d4-6d1ed83b1c15 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:09.365711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:09.373883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 666/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:11.401828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732062-4476-49e0-82d8-297940083e2b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:11.402430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732062-4476-49e0-82d8-297940083e2b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:11.402430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732062-4476-49e0-82d8-297940083e2b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:11.403819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 669/1335] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:11.409522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188520c-7936-4016-8b46-36416026b605 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:11.409941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188520c-7936-4016-8b46-36416026b605 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:11.410077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188520c-7936-4016-8b46-36416026b605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:11.477357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7188520c-7936-4016-8b46-36416026b605 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:11.478816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7188520c-7936-4016-8b46-36416026b605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:11.576064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 667/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:11.616787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a732062-4476-49e0-82d8-297940083e2b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:11.618315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3a732062-4476-49e0-82d8-297940083e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:11.658186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:11.719726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a732062-4476-49e0-82d8-297940083e2b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:11.790810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:11.791478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:11.791765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:11.792038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:11.793654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:11.873966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:11.899959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:11.901467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5bff1-6d86-432c-89d1-68e1dff7ea0d service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:11.919949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 670/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:14.386504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83de46-a058-4080-9ed5-36f49bf80bf3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:14.387044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83de46-a058-4080-9ed5-36f49bf80bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:14.387044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83de46-a058-4080-9ed5-36f49bf80bf3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:14.388473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 668/1338] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:14.393687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb87e6-5878-4c55-83f2-56dc45c30a8b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:14.394115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb87e6-5878-4c55-83f2-56dc45c30a8b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:14.394244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb87e6-5878-4c55-83f2-56dc45c30a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:14.459355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4ffb87e6-5878-4c55-83f2-56dc45c30a8b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:14.460581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4ffb87e6-5878-4c55-83f2-56dc45c30a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:14.556893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 671/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:14.592812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83de46-a058-4080-9ed5-36f49bf80bf3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:14.594915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6a83de46-a058-4080-9ed5-36f49bf80bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:14.669772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:14.696907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83de46-a058-4080-9ed5-36f49bf80bf3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:14.769361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:14.769998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:14.770276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:14.770546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:14.772181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:14.877872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:14.879292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9211488-3747-42f4-8a23-7a9e062b87e6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:14.897361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 669/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:18.873959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76ba16-7440-4139-a4be-cf59ad41b8f0 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:18.874549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76ba16-7440-4139-a4be-cf59ad41b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:18.874633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76ba16-7440-4139-a4be-cf59ad41b8f0 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:18.876201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 672/1341] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:18.881324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533714-52e5-4c04-9dd9-ac5f02668e3d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:18.881735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533714-52e5-4c04-9dd9-ac5f02668e3d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:18.881814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533714-52e5-4c04-9dd9-ac5f02668e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:18.887434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:18.959321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b9533714-52e5-4c04-9dd9-ac5f02668e3d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:18.961122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b9533714-52e5-4c04-9dd9-ac5f02668e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:19.072646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 670/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:19.111437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76ba16-7440-4139-a4be-cf59ad41b8f0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:19.113059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-aa76ba16-7440-4139-a4be-cf59ad41b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:19.163197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:19.220919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76ba16-7440-4139-a4be-cf59ad41b8f0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:19.295637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:19.296398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:19.296680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:19.296960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:19.298590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:19.393705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:19.410723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:19.412198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f6f1f-7335-4bf6-8076-5e6f0d61e3d1 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:19.430172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 673/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:22.039982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f40f4a-1aaa-441e-b4bd-6309acdea1b3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:22.040536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f40f4a-1aaa-441e-b4bd-6309acdea1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:22.040536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f40f4a-1aaa-441e-b4bd-6309acdea1b3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:22.041962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 671/1344] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:22.047815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c07f-4a8a-4094-88b3-3e4be1cde030 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:22.048251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c07f-4a8a-4094-88b3-3e4be1cde030 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:22.048354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c07f-4a8a-4094-88b3-3e4be1cde030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:22.114555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-12b3c07f-4a8a-4094-88b3-3e4be1cde030 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:22.115805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-12b3c07f-4a8a-4094-88b3-3e4be1cde030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:22.215204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 674/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:22.253550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f40f4a-1aaa-441e-b4bd-6309acdea1b3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:22.255248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d0f40f4a-1aaa-441e-b4bd-6309acdea1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:22.355637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:22.372871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f40f4a-1aaa-441e-b4bd-6309acdea1b3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:22.447165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:22.447833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:22.448110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:22.448382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:22.449994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:22.558795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:22.560263 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96144a1f-62f0-47aa-980e-ef0d4dc1c421 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:22.579042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 672/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:26.600049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55830-1da1-4d54-b4d3-46391d33c20e None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:26.600539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55830-1da1-4d54-b4d3-46391d33c20e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:26.600631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55830-1da1-4d54-b4d3-46391d33c20e None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:26.601987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 675/1347] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:26.607379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b4aa-118d-4042-b91e-f566aca26f46 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:26.607793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b4aa-118d-4042-b91e-f566aca26f46 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:26.607977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b4aa-118d-4042-b91e-f566aca26f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:26.623949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:26.677182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-40e6b4aa-118d-4042-b91e-f566aca26f46 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:26.678403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-40e6b4aa-118d-4042-b91e-f566aca26f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:26.775939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 673/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:26.814163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e55830-1da1-4d54-b4d3-46391d33c20e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:26.815756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-63e55830-1da1-4d54-b4d3-46391d33c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:26.874801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:26.922514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e55830-1da1-4d54-b4d3-46391d33c20e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:27.007661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:27.008413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:27.008705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:27.008984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:27.010659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:27.126480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:27.131158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:27.133285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15485f-2be6-499c-9642-833b4248957f service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:27.152446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 676/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:32.038944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d168b7-d84f-4b35-a81f-8218dd232358 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.040054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d168b7-d84f-4b35-a81f-8218dd232358 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.040484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d168b7-d84f-4b35-a81f-8218dd232358 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.042386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 674/1350] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:35:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:32.047694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723cb1e-ca00-4af4-940f-befad8048f36 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.048100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723cb1e-ca00-4af4-940f-befad8048f36 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.048454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723cb1e-ca00-4af4-940f-befad8048f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.191945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d723cb1e-ca00-4af4-940f-befad8048f36 None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:32.193281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d723cb1e-ca00-4af4-940f-befad8048f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:32.330370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 677/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:36.314156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43a78-fb2a-4d26-b8a2-04cc208b47ef None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.315286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43a78-fb2a-4d26-b8a2-04cc208b47ef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.315903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43a78-fb2a-4d26-b8a2-04cc208b47ef None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.317627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 675/1352] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:35:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:36.323011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938970bc-e6ac-4e16-87fc-cb282dd1b5ce None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.323464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938970bc-e6ac-4e16-87fc-cb282dd1b5ce None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.323811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938970bc-e6ac-4e16-87fc-cb282dd1b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.385932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:36.413528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-938970bc-e6ac-4e16-87fc-cb282dd1b5ce None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:36.415080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-938970bc-e6ac-4e16-87fc-cb282dd1b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:36.535847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 678/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:35:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:36.773944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=59 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:37.943443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b7a1-cc78-4364-a49f-3d017ed26250 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.944060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b7a1-cc78-4364-a49f-3d017ed26250 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.944181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b7a1-cc78-4364-a49f-3d017ed26250 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:37.945609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 676/1354] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:37.950734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bfb2-895c-48de-8a17-8d13d6b25b85 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.951149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bfb2-895c-48de-8a17-8d13d6b25b85 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.951476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bfb2-895c-48de-8a17-8d13d6b25b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:38.028086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9c84bfb2-895c-48de-8a17-8d13d6b25b85 None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:38.029418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9c84bfb2-895c-48de-8a17-8d13d6b25b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:38.072172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:38.138260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 679/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:41.466116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052a4e-274e-42e9-8b8a-8444fd18e07a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.466675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052a4e-274e-42e9-8b8a-8444fd18e07a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.466675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052a4e-274e-42e9-8b8a-8444fd18e07a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.472103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 677/1356] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:41.473679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e415-56b2-4345-9d71-a8adb26b0c14 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.474117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e415-56b2-4345-9d71-a8adb26b0c14 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.474426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e415-56b2-4345-9d71-a8adb26b0c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.577696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0ba3e415-56b2-4345-9d71-a8adb26b0c14 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:41.579549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0ba3e415-56b2-4345-9d71-a8adb26b0c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:41.691511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 680/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:35:41.751501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc6ee-c06c-4d73-95b1-504a45c09282 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.752135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc6ee-c06c-4d73-95b1-504a45c09282 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.752624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc6ee-c06c-4d73-95b1-504a45c09282 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.754418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 678/1358] 10.222.0.57 () {54 vars in 962 bytes} [Mon Jul 25 08:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:41.763813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a919-0745-4e65-aa68-2aa31d287fd3 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.764198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a919-0745-4e65-aa68-2aa31d287fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.764524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a919-0745-4e65-aa68-2aa31d287fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.788266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:41.855072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-e8a6a919-0745-4e65-aa68-2aa31d287fd3 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:41.856462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e8a6a919-0745-4e65-aa68-2aa31d287fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:41.987611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 681/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Mon Jul 25 08:35:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:41.993430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc6ee-c06c-4d73-95b1-504a45c09282 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.995106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e11fc6ee-c06c-4d73-95b1-504a45c09282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:42.152009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc6ee-c06c-4d73-95b1-504a45c09282 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:42.229436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:42.273153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:42.273810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:42.274095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:42.274369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:42.276028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:42.375306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:42.376991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6110d1-4381-4dd5-b6e8-6802886a461e service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:42.396451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 679/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:44.607160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771783e4-fa4a-4298-9c74-54f31755b077 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:44.607759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771783e4-fa4a-4298-9c74-54f31755b077 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:44.607933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771783e4-fa4a-4298-9c74-54f31755b077 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:44.609376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 682/1361] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:44.614585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b8103-a0ec-4da8-9e38-e17b33e9453e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:44.615063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b8103-a0ec-4da8-9e38-e17b33e9453e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:44.615171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b8103-a0ec-4da8-9e38-e17b33e9453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:44.684933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-281b8103-a0ec-4da8-9e38-e17b33e9453e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:44.686047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-281b8103-a0ec-4da8-9e38-e17b33e9453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:44.724905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:44.790062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 680/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:44.834781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771783e4-fa4a-4298-9c74-54f31755b077 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:44.836464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-771783e4-fa4a-4298-9c74-54f31755b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:44.917940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:45.014768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771783e4-fa4a-4298-9c74-54f31755b077 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.179100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.179951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.180351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.180742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.182693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:45.206941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:45.282134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.283786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849eec7-6800-4a33-887e-789c2e1d662e service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:45.303494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 683/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:47.661026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc768b2-466d-47b2-a28a-26bb548e28ec None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:47.661586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc768b2-466d-47b2-a28a-26bb548e28ec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:47.661586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc768b2-466d-47b2-a28a-26bb548e28ec None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:47.663177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 681/1364] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:47.668518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d51c4b-a9a2-4172-93e3-3edd87765699 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:47.668959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d51c4b-a9a2-4172-93e3-3edd87765699 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:47.669056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d51c4b-a9a2-4172-93e3-3edd87765699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:47.753536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b0d51c4b-a9a2-4172-93e3-3edd87765699 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:47.754919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b0d51c4b-a9a2-4172-93e3-3edd87765699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:47.885397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:47.899684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 684/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:35:47.935359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296098-96c5-4256-b9c5-e7e8165a943a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:47.935949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296098-96c5-4256-b9c5-e7e8165a943a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:47.936533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296098-96c5-4256-b9c5-e7e8165a943a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:47.938147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 682/1366] 10.222.0.57 () {54 vars in 962 bytes} [Mon Jul 25 08:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:47.943968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351b62-69a7-45e0-8e11-4b438ac16438 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:47.944371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351b62-69a7-45e0-8e11-4b438ac16438 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:47.944759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351b62-69a7-45e0-8e11-4b438ac16438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:48.028814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-29351b62-69a7-45e0-8e11-4b438ac16438 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:48.030705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-29351b62-69a7-45e0-8e11-4b438ac16438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:48.158301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 685/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Mon Jul 25 08:35:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:48.166641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d296098-96c5-4256-b9c5-e7e8165a943a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:48.168396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4d296098-96c5-4256-b9c5-e7e8165a943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:48.336881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d296098-96c5-4256-b9c5-e7e8165a943a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:48.360190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:48.461496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:48.462145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:48.462425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:48.462697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:48.464357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:48.569085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:48.570764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831caa6-84eb-44a8-be98-49125052d25b service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:48.589654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 683/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:49.567958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf699a9-bab9-42ac-993e-00386f6b645f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:49.568446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf699a9-bab9-42ac-993e-00386f6b645f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:49.568528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf699a9-bab9-42ac-993e-00386f6b645f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:49.570078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 686/1369] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:49.575141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcb3a-cd12-4b15-aeec-8e48a80274c2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:49.575571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcb3a-cd12-4b15-aeec-8e48a80274c2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:49.575809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcb3a-cd12-4b15-aeec-8e48a80274c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:49.609430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:49.647342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8a8bcb3a-cd12-4b15-aeec-8e48a80274c2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:49.648577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8a8bcb3a-cd12-4b15-aeec-8e48a80274c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:49.756818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 684/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:50.127185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530da64-8d75-4de1-8b88-5bac869b00ab None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:50.127719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530da64-8d75-4de1-8b88-5bac869b00ab None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:50.128170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530da64-8d75-4de1-8b88-5bac869b00ab None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:50.129701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 687/1371] 10.222.0.57 () {54 vars in 964 bytes} [Mon Jul 25 08:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:50.134694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e7b0-11f5-4e63-b722-35c05de5ce38 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:50.135183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e7b0-11f5-4e63-b722-35c05de5ce38 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:50.135656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e7b0-11f5-4e63-b722-35c05de5ce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:50.215291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-57b5e7b0-11f5-4e63-b722-35c05de5ce38 None None] MFA Rules not processed for user `0a6925d9c52e4bf9ab900755b8aac7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:50.216467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-57b5e7b0-11f5-4e63-b722-35c05de5ce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:50.280831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:50.314485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 685/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Mon Jul 25 08:35:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:50.322094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530da64-8d75-4de1-8b88-5bac869b00ab None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:50.323697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2530da64-8d75-4de1-8b88-5bac869b00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:50.382424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:50.442779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530da64-8d75-4de1-8b88-5bac869b00ab None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:50.519751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:50.520404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:50.520692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:50.520970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:50.522620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:50.639696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:50.654180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:50.655633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0e6d-aa5e-4dba-a9d3-741c027b7427 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:50.675204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 688/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:50.705079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf530a-6085-4a67-8a6f-7618641815c2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:50.705606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf530a-6085-4a67-8a6f-7618641815c2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:50.705847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf530a-6085-4a67-8a6f-7618641815c2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:50.707686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 686/1374] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:35:50.712344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72383c-0287-4504-bfbd-52d75aa58bc1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:50.712855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72383c-0287-4504-bfbd-52d75aa58bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:50.713208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72383c-0287-4504-bfbd-52d75aa58bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:50.783084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6a72383c-0287-4504-bfbd-52d75aa58bc1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:50.784116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6a72383c-0287-4504-bfbd-52d75aa58bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:50.883650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 689/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:50.931445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf530a-6085-4a67-8a6f-7618641815c2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:50.931445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a3bf530a-6085-4a67-8a6f-7618641815c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:51.096782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf530a-6085-4a67-8a6f-7618641815c2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:51.148042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:51.210277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:51.210931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:51.211218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:51.211534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:51.213182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:51.304396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:51.306013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1d869-bef8-449d-aba3-936242e65a27 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:51.326361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 687/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:53.332158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d1a0f-8c5c-482f-9941-2a415e848fb6 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:53.332645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d1a0f-8c5c-482f-9941-2a415e848fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:53.332645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d1a0f-8c5c-482f-9941-2a415e848fb6 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:53.334022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 690/1377] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:53.339060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fad7b9-9482-4a84-b265-e357453517ef None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:53.339509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fad7b9-9482-4a84-b265-e357453517ef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:53.340769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fad7b9-9482-4a84-b265-e357453517ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:53.406953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-51fad7b9-9482-4a84-b265-e357453517ef None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:53.408174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-51fad7b9-9482-4a84-b265-e357453517ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:53.414836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:53.510346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 688/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:53.554832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d1a0f-8c5c-482f-9941-2a415e848fb6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:53.556455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-034d1a0f-8c5c-482f-9941-2a415e848fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:53.623584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:53.729676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d1a0f-8c5c-482f-9941-2a415e848fb6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:53.841179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:53.841827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:53.842112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:53.842404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:53.844099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:53.862921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:53.947233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:53.948944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeae3f3-fc73-4ffe-8070-33181033693f service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:53.966815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 691/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:56.029678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb062b6-74dc-424a-8171-e7f426710f08 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.030847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb062b6-74dc-424a-8171-e7f426710f08 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.030847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb062b6-74dc-424a-8171-e7f426710f08 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.032401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 689/1380] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:56.037577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666146-76b3-4a0d-88a8-3922f5afdc47 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.038021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666146-76b3-4a0d-88a8-3922f5afdc47 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.038124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666146-76b3-4a0d-88a8-3922f5afdc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.108739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a2666146-76b3-4a0d-88a8-3922f5afdc47 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:56.109946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a2666146-76b3-4a0d-88a8-3922f5afdc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:56.219056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:56.229842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 692/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:56.270702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb062b6-74dc-424a-8171-e7f426710f08 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:56.272273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dcb062b6-74dc-424a-8171-e7f426710f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:56.417873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:56.430430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb062b6-74dc-424a-8171-e7f426710f08 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:56.555419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:56.556425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.556778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.557125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.558835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:56.654414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:56.656156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7dca-bca0-4e52-996d-bb92685c24c8 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:56.667162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:56.677756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 690/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:35:58.746896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83667-c18f-43c9-ba0f-45a7a470b7ac None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:58.747719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83667-c18f-43c9-ba0f-45a7a470b7ac None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:58.747719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83667-c18f-43c9-ba0f-45a7a470b7ac None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:58.748898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 693/1383] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:58.754102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfc663-a23a-43e4-8a5c-f0ed6b1cc1b0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:58.754570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfc663-a23a-43e4-8a5c-f0ed6b1cc1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:58.754669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfc663-a23a-43e4-8a5c-f0ed6b1cc1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:58.832419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7cbfc663-a23a-43e4-8a5c-f0ed6b1cc1b0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:58.833954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7cbfc663-a23a-43e4-8a5c-f0ed6b1cc1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:58.947573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 691/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:35:58.998168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83667-c18f-43c9-ba0f-45a7a470b7ac None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:58.999852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0db83667-c18f-43c9-ba0f-45a7a470b7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:59.151415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83667-c18f-43c9-ba0f-45a7a470b7ac None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:59.222664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:59.268062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:59.268720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:59.269004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:59.269281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:59.270956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:59.374590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:59.376242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650de51-61fe-4468-8c80-1ce695e9c336 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:59.396438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 694/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:01.406111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e837-a0c4-422c-b721-b766adb51bfc None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:01.406649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e837-a0c4-422c-b721-b766adb51bfc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:01.406649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e837-a0c4-422c-b721-b766adb51bfc None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:01.408074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 692/1386] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:01.413393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de71c0-8568-4661-a8c3-c8abe1a51656 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:01.413942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de71c0-8568-4661-a8c3-c8abe1a51656 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:01.414046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de71c0-8568-4661-a8c3-c8abe1a51656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:01.484540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-90de71c0-8568-4661-a8c3-c8abe1a51656 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:01.485765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-90de71c0-8568-4661-a8c3-c8abe1a51656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:01.519268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:01.588042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 695/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:36:01.633345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990e837-a0c4-422c-b721-b766adb51bfc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:01.634961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e990e837-a0c4-422c-b721-b766adb51bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:01.716289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:01.806961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990e837-a0c4-422c-b721-b766adb51bfc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:01.945450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:01.946110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:01.946395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:01.946682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:01.948363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:01.993591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:02.047343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:02.049015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b4990-4b52-45e7-b3da-be63a950437e service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:02.068867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 693/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:04.408045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0623b-fe56-49af-a08d-ac9a4d1887bf None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:04.408580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0623b-fe56-49af-a08d-ac9a4d1887bf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:04.408672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0623b-fe56-49af-a08d-ac9a4d1887bf None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:04.410011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 696/1389] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:04.415350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d16b-778f-4d96-a938-9694091f3d15 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:04.415794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d16b-778f-4d96-a938-9694091f3d15 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:04.415951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d16b-778f-4d96-a938-9694091f3d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:04.482950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-cbb4d16b-778f-4d96-a938-9694091f3d15 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:04.484190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cbb4d16b-778f-4d96-a938-9694091f3d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:04.583658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 694/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:04.628157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0623b-fe56-49af-a08d-ac9a4d1887bf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:04.629671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b5b0623b-fe56-49af-a08d-ac9a4d1887bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:04.777571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0623b-fe56-49af-a08d-ac9a4d1887bf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:04.795032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:04.893350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:04.894000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:04.894285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:04.894559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:04.896236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:04.983617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:04.985204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48c83-284c-4c74-895b-8b2c0b850f6f service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:05.003792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 697/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:05.649460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808165d-4c04-4396-b3ff-81fb1c9c7541 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:05.650024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808165d-4c04-4396-b3ff-81fb1c9c7541 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:05.650024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808165d-4c04-4396-b3ff-81fb1c9c7541 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:05.651435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 695/1392] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:05.656573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35754201-be70-4f3a-b21b-26717814a074 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:05.657004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35754201-be70-4f3a-b21b-26717814a074 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:05.657132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35754201-be70-4f3a-b21b-26717814a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:05.683276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:05.725644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-35754201-be70-4f3a-b21b-26717814a074 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:05.726871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-35754201-be70-4f3a-b21b-26717814a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:05.843793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 698/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:05.901470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a02de-1475-40c1-ab05-09f7539d4260 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:05.901753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a02de-1475-40c1-ab05-09f7539d4260 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:05.902026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a02de-1475-40c1-ab05-09f7539d4260 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:05.903408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 696/1394] 10.222.0.57 () {54 vars in 966 bytes} [Mon Jul 25 08:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:05.908875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27308f6-c0b5-4820-ae6b-50816f454756 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:05.909246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27308f6-c0b5-4820-ae6b-50816f454756 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:05.909594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27308f6-c0b5-4820-ae6b-50816f454756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:05.985099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-f27308f6-c0b5-4820-ae6b-50816f454756 None None] MFA Rules not processed for user `a758c6680078465d8d65ffd105594530`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:05.986282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f27308f6-c0b5-4820-ae6b-50816f454756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:06.029103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:06.066284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 699/1395] 10.222.0.57 () {58 vars in 1063 bytes} [Mon Jul 25 08:36:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:06.073736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a02de-1475-40c1-ab05-09f7539d4260 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:06.075272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-038a02de-1475-40c1-ab05-09f7539d4260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:06.089539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:06.183334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a02de-1475-40c1-ab05-09f7539d4260 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:06.256638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:06.257278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:06.257559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:06.257826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:06.259473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:06.329814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:06.371237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:06.372707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438401-d156-448c-a350-047dbb0fc3f8 service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:06.392094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 697/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:07.036770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84bdef-2a8c-4226-985c-02f81b46522c None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.037338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84bdef-2a8c-4226-985c-02f81b46522c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.037338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84bdef-2a8c-4226-985c-02f81b46522c None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.038909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 700/1397] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:07.044270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.044793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.044899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.116192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:07.117478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:07.118387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d97e-4b12-4481-9a60-98bb4477e30c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.118676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d97e-4b12-4481-9a60-98bb4477e30c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.118951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d97e-4b12-4481-9a60-98bb4477e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.186273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7063d97e-4b12-4481-9a60-98bb4477e30c None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:07.187420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7063d97e-4b12-4481-9a60-98bb4477e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:07.216741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 698/1398] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:07.262447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:07.263783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:07.272550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 701/1399] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:36:07.291651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:07.315833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a8bd8-f73e-476d-80fc-a2a5cfe7db98 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.316159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a8bd8-f73e-476d-80fc-a2a5cfe7db98 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.316476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a8bd8-f73e-476d-80fc-a2a5cfe7db98 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.317872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 702/1400] 10.222.0.57 () {54 vars in 943 bytes} [Mon Jul 25 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:36:07.323823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.324195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.324539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.385044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e486-80f5-4ab0-9361-7aa41c8d5acc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:07.394698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:07.403093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] MFA Rules not processed for user `6da2eb51566940d7bee3a44f019e06ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:07.404338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:07.502147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:07.502804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.503087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.503361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.505065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:07.513227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 703/1401] 10.222.0.57 () {58 vars in 1040 bytes} [Mon Jul 25 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:36:07.522506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:07.522822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:07.533374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5c619-88e0-40a2-8142-1f20358238ce None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:07.599410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:07.601042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a43f9e-af54-4b13-92a2-08be848e75a4 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:07.619928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 699/1402] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:36:07.638920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:07.639657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:07.639945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:07.640226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:07.641947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:07.644702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:07.735495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:07.737142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca867b-998c-4240-88d6-4b1ab6af29b3 service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:07.746605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 704/1403] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:36:09.675656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a9cb6-ee48-448c-8ff4-3e611ba86e04 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:09.676244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a9cb6-ee48-448c-8ff4-3e611ba86e04 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:09.676244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a9cb6-ee48-448c-8ff4-3e611ba86e04 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:09.677708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 700/1404] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:09.682755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0df0f-32a2-43dd-8656-1a01ef751227 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:09.683214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0df0f-32a2-43dd-8656-1a01ef751227 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:09.683315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0df0f-32a2-43dd-8656-1a01ef751227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:09.754123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1ef0df0f-32a2-43dd-8656-1a01ef751227 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:09.755257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1ef0df0f-32a2-43dd-8656-1a01ef751227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:09.858270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:09.866499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 705/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:09.911666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a9cb6-ee48-448c-8ff4-3e611ba86e04 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:09.913199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-936a9cb6-ee48-448c-8ff4-3e611ba86e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:10.084160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:10.086901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a9cb6-ee48-448c-8ff4-3e611ba86e04 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:10.219452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:10.220119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:10.220534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:10.220817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:10.222513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:10.347007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:10.348827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb004-11d9-4ca7-8fa1-32af3b7c459c service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:10.375627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 701/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:12.408783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cead-8922-40b0-aaf6-fb2ce107a404 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:12.409322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cead-8922-40b0-aaf6-fb2ce107a404 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:12.409322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cead-8922-40b0-aaf6-fb2ce107a404 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:12.410788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 706/1407] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:12.415908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f877bd-0739-41ed-85d8-e798c264b18f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:12.416321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f877bd-0739-41ed-85d8-e798c264b18f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:12.416519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f877bd-0739-41ed-85d8-e798c264b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:12.421842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:12.490069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a8f877bd-0739-41ed-85d8-e798c264b18f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:12.491318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a8f877bd-0739-41ed-85d8-e798c264b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:12.601940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 702/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:12.650272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627cead-8922-40b0-aaf6-fb2ce107a404 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:12.651927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6627cead-8922-40b0-aaf6-fb2ce107a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:12.816481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627cead-8922-40b0-aaf6-fb2ce107a404 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:12.891461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:12.943698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:12.944479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:12.944769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:12.945041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:12.946696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:13.045253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:13.046860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89911f70-b9db-42bc-b4b1-d8bb5744c7b8 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:13.067139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 707/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:22.599606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=64 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:23.063789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=64 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:29.998781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09c07e-4448-4598-bfba-ca57c74b3dc3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:29.999356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09c07e-4448-4598-bfba-ca57c74b3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:29.999356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09c07e-4448-4598-bfba-ca57c74b3dc3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:30.000731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 703/1410] 10.222.0.57 () {54 vars in 918 bytes} [Mon Jul 25 08:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:30.006642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefa261-08fb-4445-8dbb-6249e09c34d4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:30.007081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefa261-08fb-4445-8dbb-6249e09c34d4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:30.007222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefa261-08fb-4445-8dbb-6249e09c34d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:30.083033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3eefa261-08fb-4445-8dbb-6249e09c34d4 None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:30.084274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3eefa261-08fb-4445-8dbb-6249e09c34d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:30.189281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 708/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Jul 25 08:36:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:30.203907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaf0fd-aa9f-4b4b-9094-3edd093c764d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:30.204202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaf0fd-aa9f-4b4b-9094-3edd093c764d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:30.204482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaf0fd-aa9f-4b4b-9094-3edd093c764d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:30.205839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 704/1412] 10.222.0.57 () {54 vars in 918 bytes} [Mon Jul 25 08:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:30.210498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b29e-393b-464a-a856-55f4906f1194 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:30.210791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b29e-393b-464a-a856-55f4906f1194 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:30.211099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b29e-393b-464a-a856-55f4906f1194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:30.283502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:30.286741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8e82b29e-393b-464a-a856-55f4906f1194 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:30.288806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8e82b29e-393b-464a-a856-55f4906f1194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:30.403692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 709/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Jul 25 08:36:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:32.852257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2607-a526-40ab-8aaa-0784a9e19442 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:32.852762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2607-a526-40ab-8aaa-0784a9e19442 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:32.852762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2607-a526-40ab-8aaa-0784a9e19442 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:32.854364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:32.860152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77bbb-63b9-4b77-8c91-45a950ed07b2 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:32.860583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77bbb-63b9-4b77-8c91-45a950ed07b2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:32.860722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77bbb-63b9-4b77-8c91-45a950ed07b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:32.926353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-26b77bbb-63b9-4b77-8c91-45a950ed07b2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:32.927591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-26b77bbb-63b9-4b77-8c91-45a950ed07b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:32.982100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:33.025746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:33.068899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2607-a526-40ab-8aaa-0784a9e19442 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:33.070434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1f1a2607-a526-40ab-8aaa-0784a9e19442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:33.211303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2607-a526-40ab-8aaa-0784a9e19442 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:33.282286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:33.322869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:33.323570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:33.323850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:33.324124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:33.325738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:33.413619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:33.415217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214301d-7c33-4e39-89e2-302316538a0d service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:33.432731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 706/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:34.346214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dea19-f891-4651-87cd-f0a59217bceb None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:34.346825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dea19-f891-4651-87cd-f0a59217bceb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:34.346825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dea19-f891-4651-87cd-f0a59217bceb None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:34.348208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:34.353042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78bf6a-468e-4b1e-aaf1-f00d1d3270c6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:34.353748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78bf6a-468e-4b1e-aaf1-f00d1d3270c6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:34.353895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78bf6a-468e-4b1e-aaf1-f00d1d3270c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:34.430503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0f78bf6a-468e-4b1e-aaf1-f00d1d3270c6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:34.431743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0f78bf6a-468e-4b1e-aaf1-f00d1d3270c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:34.458543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:34.527799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:34.682812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dea19-f891-4651-87cd-f0a59217bceb None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:34.684276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ff2dea19-f891-4651-87cd-f0a59217bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:34.827125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dea19-f891-4651-87cd-f0a59217bceb None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:34.867127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:34.938590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:34.939143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:34.939522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:34.939805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:34.941419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:35.027626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:35.029198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea79820-783f-4ff7-bb1f-01a6314d5477 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:35.047604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 712/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:35.916737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568eee7-9a65-4b2e-9b0c-f09752acce74 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:35.917250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568eee7-9a65-4b2e-9b0c-f09752acce74 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:35.917250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568eee7-9a65-4b2e-9b0c-f09752acce74 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:35.918582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:35.924275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98b923-b54b-4c39-aabe-3ca0552f412f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:35.924655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98b923-b54b-4c39-aabe-3ca0552f412f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:35.924848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98b923-b54b-4c39-aabe-3ca0552f412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:35.978269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:36.000994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1f98b923-b54b-4c39-aabe-3ca0552f412f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:36.002193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1f98b923-b54b-4c39-aabe-3ca0552f412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:36.097662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:36.249340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568eee7-9a65-4b2e-9b0c-f09752acce74 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:36.250782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b568eee7-9a65-4b2e-9b0c-f09752acce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:36.395969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568eee7-9a65-4b2e-9b0c-f09752acce74 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:36.408551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:36.507727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:36.508378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:36.508666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:36.508941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:36.510634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:36.600403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:36.602002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1ce09-e718-4c3c-8950-61dfc728c618 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:36.619918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 709/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:37.470591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c45e-9839-4379-89b3-1af5bf14f94f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:37.471164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c45e-9839-4379-89b3-1af5bf14f94f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:37.471164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c45e-9839-4379-89b3-1af5bf14f94f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:37.472556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:37.477390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a58a-2ec4-4b52-abe0-1316ddd2c25f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:37.477800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a58a-2ec4-4b52-abe0-1316ddd2c25f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:37.477953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a58a-2ec4-4b52-abe0-1316ddd2c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:37.498984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:37.556300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5564a58a-2ec4-4b52-abe0-1316ddd2c25f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:37.557523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5564a58a-2ec4-4b52-abe0-1316ddd2c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:37.652806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:37.802209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c45e-9839-4379-89b3-1af5bf14f94f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:37.803803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3f23c45e-9839-4379-89b3-1af5bf14f94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:37.914553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:37.949812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c45e-9839-4379-89b3-1af5bf14f94f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:38.060447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:38.061022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:38.061305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:38.061580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:38.063219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:38.141685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:38.156598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:38.159269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7bd23-78f0-4095-88ff-b2023274c775 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:38.179278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 715/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:39.032638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99f2b-d195-4061-ac9c-7fe6c57ef2d4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:39.033192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99f2b-d195-4061-ac9c-7fe6c57ef2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:39.033668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99f2b-d195-4061-ac9c-7fe6c57ef2d4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:39.036324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:36:39.041477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a4dc-3811-46a8-87a5-95857f96f1d5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:39.042193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a4dc-3811-46a8-87a5-95857f96f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:39.042193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a4dc-3811-46a8-87a5-95857f96f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:39.117800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0c06a4dc-3811-46a8-87a5-95857f96f1d5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:39.119024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0c06a4dc-3811-46a8-87a5-95857f96f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:39.214558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:36:39.367887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99f2b-d195-4061-ac9c-7fe6c57ef2d4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:39.369337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4ce99f2b-d195-4061-ac9c-7fe6c57ef2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:39.453045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:39.514806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99f2b-d195-4061-ac9c-7fe6c57ef2d4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:39.627224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:39.627837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:39.628123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:39.628398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:39.630035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:39.678233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:39.721902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:39.723561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2899-2a66-4b98-900e-902b3eacf6b4 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:39.741689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 712/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:40.540160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010613c1-9e9f-4e84-a8a9-53dac97639bf None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:40.540721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010613c1-9e9f-4e84-a8a9-53dac97639bf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:40.540721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010613c1-9e9f-4e84-a8a9-53dac97639bf None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:40.542094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:40.547638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484484f5-ee89-4839-a489-d9fbc63c62e4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:40.548060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484484f5-ee89-4839-a489-d9fbc63c62e4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:40.548209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484484f5-ee89-4839-a489-d9fbc63c62e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:40.625150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-484484f5-ee89-4839-a489-d9fbc63c62e4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:40.626364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-484484f5-ee89-4839-a489-d9fbc63c62e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:40.721631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:40.871174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010613c1-9e9f-4e84-a8a9-53dac97639bf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:40.872646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-010613c1-9e9f-4e84-a8a9-53dac97639bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:40.921366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:41.016990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010613c1-9e9f-4e84-a8a9-53dac97639bf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:41.129408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:41.129985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:41.130268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:41.130544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:41.132224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:41.139191 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:41.220399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:41.222011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f68f94-a8f8-467c-8d5d-3af707a45d7d service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:41.240453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 718/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:42.032485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec225-71e0-46a7-bef6-1203b0a3589f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:42.033017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec225-71e0-46a7-bef6-1203b0a3589f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:42.033017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec225-71e0-46a7-bef6-1203b0a3589f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:42.034409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:42.039300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4780a-73c7-4b92-a39f-3ba14cce7107 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:42.039733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4780a-73c7-4b92-a39f-3ba14cce7107 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:42.039888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4780a-73c7-4b92-a39f-3ba14cce7107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:42.115266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-06b4780a-73c7-4b92-a39f-3ba14cce7107 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:42.116496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-06b4780a-73c7-4b92-a39f-3ba14cce7107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:42.186728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:42.216915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:42.366641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec225-71e0-46a7-bef6-1203b0a3589f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:42.368184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-13dec225-71e0-46a7-bef6-1203b0a3589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:42.386111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:42.513044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec225-71e0-46a7-bef6-1203b0a3589f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:42.598750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:42.625321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:42.625960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:42.626241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:42.626516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:42.628175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:42.714758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:42.716395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c301c-0a02-4cd8-9f66-d0bee13b0885 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:42.734543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 715/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:43.540174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6486-6b48-4942-a5a5-7db185a8e220 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:43.540709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6486-6b48-4942-a5a5-7db185a8e220 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:43.540821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6486-6b48-4942-a5a5-7db185a8e220 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:43.542132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:43.547176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512242d-9196-4a82-ad17-8900acca1782 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:43.547650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512242d-9196-4a82-ad17-8900acca1782 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:43.547750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512242d-9196-4a82-ad17-8900acca1782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:43.624416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f512242d-9196-4a82-ad17-8900acca1782 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:43.625629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f512242d-9196-4a82-ad17-8900acca1782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:43.666766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:43.724054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:43.876752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee6486-6b48-4942-a5a5-7db185a8e220 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:43.878198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0dee6486-6b48-4942-a5a5-7db185a8e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:44.026141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee6486-6b48-4942-a5a5-7db185a8e220 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:44.080124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:44.139212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:44.140263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:44.140691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:44.141193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:44.143229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:44.235570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:44.237184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f2d1-095b-4c94-a040-8e9ea0c4c707 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:44.255795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 721/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:45.045641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b57a5-9611-42ad-9e88-8a64071e7a1b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:45.046089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b57a5-9611-42ad-9e88-8a64071e7a1b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:45.046195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b57a5-9611-42ad-9e88-8a64071e7a1b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:45.047605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:45.052552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404aa8a-857a-4d64-bc3a-e75e881007b1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:45.052988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404aa8a-857a-4d64-bc3a-e75e881007b1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:45.053242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404aa8a-857a-4d64-bc3a-e75e881007b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:45.128981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4404aa8a-857a-4d64-bc3a-e75e881007b1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:45.130197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4404aa8a-857a-4d64-bc3a-e75e881007b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:45.132252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:45.227177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:45.378716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b57a5-9611-42ad-9e88-8a64071e7a1b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:45.380184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-216b57a5-9611-42ad-9e88-8a64071e7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:45.527753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b57a5-9611-42ad-9e88-8a64071e7a1b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:45.554958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:45.640813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:45.641386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:45.641670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:45.641946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:45.643614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:45.732615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:45.734222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0780c-cd59-4462-8a3c-59020c3b9c75 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:45.752575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 718/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:47.624155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3ad93-00db-422e-96de-531786a8c84f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:47.624680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3ad93-00db-422e-96de-531786a8c84f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:47.624789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3ad93-00db-422e-96de-531786a8c84f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:47.626091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:47.631402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaabc9-1e71-412f-bbee-ac73bbc8f805 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:47.631825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaabc9-1e71-412f-bbee-ac73bbc8f805 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:47.631971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaabc9-1e71-412f-bbee-ac73bbc8f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:47.673728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:47.698693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bebaabc9-1e71-412f-bbee-ac73bbc8f805 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:47.699921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bebaabc9-1e71-412f-bbee-ac73bbc8f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:47.798028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:47.835962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3ad93-00db-422e-96de-531786a8c84f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:47.837562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b4d3ad93-00db-422e-96de-531786a8c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:48.065657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3ad93-00db-422e-96de-531786a8c84f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:48.097200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:48.139037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:48.139721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:48.140000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:48.140277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:48.141942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:48.251112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:48.252602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc613a-9164-49ae-85a2-82e6f8b6ff66 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:48.271160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 724/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:50.423905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9c2b-ae1c-440d-8f20-02797ccffb97 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:50.424465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9c2b-ae1c-440d-8f20-02797ccffb97 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:50.424465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9c2b-ae1c-440d-8f20-02797ccffb97 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:50.425857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:50.431107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bd65-19f9-4ca3-b7fa-06c07ea04bdb None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:50.431526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bd65-19f9-4ca3-b7fa-06c07ea04bdb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:50.431715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bd65-19f9-4ca3-b7fa-06c07ea04bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:50.496955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-07f4bd65-19f9-4ca3-b7fa-06c07ea04bdb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:50.498172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-07f4bd65-19f9-4ca3-b7fa-06c07ea04bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:50.510789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:50.593869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:50.631500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9c2b-ae1c-440d-8f20-02797ccffb97 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:50.633020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7e4e9c2b-ae1c-440d-8f20-02797ccffb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:50.735216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9c2b-ae1c-440d-8f20-02797ccffb97 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:50.747401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:50.808728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:50.809301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:50.809585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:50.809862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:50.811527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:50.920128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:50.921559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c0aea-99e3-411c-9b2f-2c5a0a643746 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:50.939134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 721/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:36:53.216848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443706c-066b-46fe-bba6-18d60d4927fc None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:53.217430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443706c-066b-46fe-bba6-18d60d4927fc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:53.217430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443706c-066b-46fe-bba6-18d60d4927fc None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:53.218774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:53.223963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4e6c6-8ac8-445f-ad5e-9a548fa82a13 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:53.224354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4e6c6-8ac8-445f-ad5e-9a548fa82a13 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:53.224519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4e6c6-8ac8-445f-ad5e-9a548fa82a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:53.272484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:53.290678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-37d4e6c6-8ac8-445f-ad5e-9a548fa82a13 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:53.291927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-37d4e6c6-8ac8-445f-ad5e-9a548fa82a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:53.388770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:53.427012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443706c-066b-46fe-bba6-18d60d4927fc None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:53.428570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6443706c-066b-46fe-bba6-18d60d4927fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:53.535237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443706c-066b-46fe-bba6-18d60d4927fc None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:53.576378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:53.609831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:53.610504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:53.610795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:53.611073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:53.612926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:53.720037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:53.721468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c488d-f707-43c2-a244-27b54e55912d service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:53.740061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 727/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:55.860977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3770-6d32-462a-909e-72e1dc5b9294 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:55.861519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3770-6d32-462a-909e-72e1dc5b9294 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:55.861519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3770-6d32-462a-909e-72e1dc5b9294 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:55.862872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:36:55.868237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806a56-f551-4711-bd73-30ae3b4986df None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:55.868682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806a56-f551-4711-bd73-30ae3b4986df None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:55.868824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806a56-f551-4711-bd73-30ae3b4986df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:55.933620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4b806a56-f551-4711-bd73-30ae3b4986df None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:55.935375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4b806a56-f551-4711-bd73-30ae3b4986df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:55.955323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:56.029776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:56.069649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a3770-6d32-462a-909e-72e1dc5b9294 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:56.071204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ad6a3770-6d32-462a-909e-72e1dc5b9294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:56.299084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a3770-6d32-462a-909e-72e1dc5b9294 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:56.319324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:56.373586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:56.374228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:56.374507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:56.374781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:56.376443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:56.482419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:56.483878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493f66-9ad7-473d-9811-071665bf4082 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:56.501337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 724/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:36:58.582866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc04bad-f98c-4ee1-98af-8700ca903e5d None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:58.583364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc04bad-f98c-4ee1-98af-8700ca903e5d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:58.583509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc04bad-f98c-4ee1-98af-8700ca903e5d None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:58.584823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:36:58.589972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd633e-66bc-4810-b3a4-8fc91589ebb5 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:58.590406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd633e-66bc-4810-b3a4-8fc91589ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:58.590540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd633e-66bc-4810-b3a4-8fc91589ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:58.653904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:58.657118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-15fd633e-66bc-4810-b3a4-8fc91589ebb5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:36:58.658726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-15fd633e-66bc-4810-b3a4-8fc91589ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:58.752600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:36:58.789707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc04bad-f98c-4ee1-98af-8700ca903e5d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:36:58.791233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4bc04bad-f98c-4ee1-98af-8700ca903e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:58.894230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc04bad-f98c-4ee1-98af-8700ca903e5d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:36:58.941776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:58.966937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:36:58.967611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:36:58.967895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:36:58.968166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:36:58.969795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:36:59.077406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:36:59.078851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15798671-1c85-4e54-94be-02f62e9b749e service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:36:59.097115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 730/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:01.155235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4809f-c8db-4ebf-907c-08a35d461ce8 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:01.155838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4809f-c8db-4ebf-907c-08a35d461ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:01.155838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4809f-c8db-4ebf-907c-08a35d461ce8 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:01.157210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:37:01.162494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0805-4ee8-4190-9dba-c54ff599d3b4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:01.162919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0805-4ee8-4190-9dba-c54ff599d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:01.163032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0805-4ee8-4190-9dba-c54ff599d3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:01.227292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-980d0805-4ee8-4190-9dba-c54ff599d3b4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:01.228758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-980d0805-4ee8-4190-9dba-c54ff599d3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:01.256423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:01.322058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:01.360662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4809f-c8db-4ebf-907c-08a35d461ce8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:01.362206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b1b4809f-c8db-4ebf-907c-08a35d461ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:01.466965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4809f-c8db-4ebf-907c-08a35d461ce8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:01.496404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:01.541816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:01.542471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:01.542754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:01.543034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:01.545327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:01.652450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:01.654433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175c05-af2f-416b-ae1e-ad85ea50c3b9 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:01.673010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 727/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:03.732250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed313e-61fd-46a6-9dbd-e469b8b3538b None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:03.732779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed313e-61fd-46a6-9dbd-e469b8b3538b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:03.732871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed313e-61fd-46a6-9dbd-e469b8b3538b None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:03.734225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:03.739693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c9e0-8726-4f08-9102-ab7190f23d4c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:03.740103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c9e0-8726-4f08-9102-ab7190f23d4c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:03.740274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c9e0-8726-4f08-9102-ab7190f23d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:03.805520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bd76c9e0-8726-4f08-9102-ab7190f23d4c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:03.806645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bd76c9e0-8726-4f08-9102-ab7190f23d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:03.815559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:03.904250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:03.941177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed313e-61fd-46a6-9dbd-e469b8b3538b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:03.942718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e1ed313e-61fd-46a6-9dbd-e469b8b3538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:04.044736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed313e-61fd-46a6-9dbd-e469b8b3538b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:04.098523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:04.116424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:04.117064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:04.117351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:04.117626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:04.119250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:04.226719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:04.228442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d76f35-183e-4335-ae6e-ff8415e9c1e0 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:04.247029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 733/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:37:06.260954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc22a-92bf-4dda-8f85-5aacbf9faa02 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:06.261498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc22a-92bf-4dda-8f85-5aacbf9faa02 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:06.261498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc22a-92bf-4dda-8f85-5aacbf9faa02 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:06.263534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:06.268790 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76461b-5004-4e02-9968-8c1489cb939a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:06.269190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76461b-5004-4e02-9968-8c1489cb939a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:06.269366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76461b-5004-4e02-9968-8c1489cb939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:06.335300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4e76461b-5004-4e02-9968-8c1489cb939a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:06.336550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4e76461b-5004-4e02-9968-8c1489cb939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:06.375234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:06.432538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:06.469428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc22a-92bf-4dda-8f85-5aacbf9faa02 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:06.470955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0d0dc22a-92bf-4dda-8f85-5aacbf9faa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:06.574082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc22a-92bf-4dda-8f85-5aacbf9faa02 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:06.620391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:06.655850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:06.656491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:06.656772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:06.657044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:06.658666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:06.765811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:06.767256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40466431-3e38-4868-82c1-2d90a4e395c0 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:06.785506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 730/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:08.822937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90614ed3-10d1-4577-8305-125879868e1a None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:08.823474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90614ed3-10d1-4577-8305-125879868e1a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:08.823474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90614ed3-10d1-4577-8305-125879868e1a None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:08.824882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:08.830183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348089f-539b-4646-99a0-b525eb6cd6c7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:08.830631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348089f-539b-4646-99a0-b525eb6cd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:08.830771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348089f-539b-4646-99a0-b525eb6cd6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:08.895878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2348089f-539b-4646-99a0-b525eb6cd6c7 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:08.897093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2348089f-539b-4646-99a0-b525eb6cd6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:08.914627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:08.992594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:09.029154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90614ed3-10d1-4577-8305-125879868e1a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:09.030675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-90614ed3-10d1-4577-8305-125879868e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:09.131344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90614ed3-10d1-4577-8305-125879868e1a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:09.196762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:09.203901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:09.204546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:09.204834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:09.205113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:09.206744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:09.315471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:09.316913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f6eab-027d-4e7f-8e4d-a4df0e8cbfe1 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:09.334706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 736/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:11.352194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb167d-49a4-4622-9a58-897ae95873e0 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:11.353014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb167d-49a4-4622-9a58-897ae95873e0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:11.353014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb167d-49a4-4622-9a58-897ae95873e0 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:11.354391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:11.360202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f574-92e3-4cd9-a7d7-25ba20e610b4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:11.360615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f574-92e3-4cd9-a7d7-25ba20e610b4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:11.360762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f574-92e3-4cd9-a7d7-25ba20e610b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:11.426710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9686f574-92e3-4cd9-a7d7-25ba20e610b4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:11.427943 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9686f574-92e3-4cd9-a7d7-25ba20e610b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:11.475477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:11.524495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:11.561663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb167d-49a4-4622-9a58-897ae95873e0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:11.563196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2afb167d-49a4-4622-9a58-897ae95873e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:11.665441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb167d-49a4-4622-9a58-897ae95873e0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:11.711677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:11.737717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:11.738362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:11.738642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:11.738914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:11.740608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:11.850791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:11.852277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2a76a-075f-484d-9de2-b58577ef8475 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:11.870195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 733/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:21.522631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=22 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:21.867926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=66 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:31.329944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23748-9f7c-4389-a73d-1051e9c5fc05 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:31.330469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23748-9f7c-4389-a73d-1051e9c5fc05 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:31.330469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23748-9f7c-4389-a73d-1051e9c5fc05 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:31.331879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 738/1471] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:31.337378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a09e-0483-4ee2-b794-64c13d3b7cfb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:31.337800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a09e-0483-4ee2-b794-64c13d3b7cfb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:31.337937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a09e-0483-4ee2-b794-64c13d3b7cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:31.404384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-df35a09e-0483-4ee2-b794-64c13d3b7cfb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:31.405589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-df35a09e-0483-4ee2-b794-64c13d3b7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:31.499326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 734/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:31.583242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c828b-4a6d-4b92-9e08-4659be25e380 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:31.583510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c828b-4a6d-4b92-9e08-4659be25e380 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:31.583799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c828b-4a6d-4b92-9e08-4659be25e380 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:31.585212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 739/1473] 10.222.0.57 () {54 vars in 966 bytes} [Mon Jul 25 08:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:31.589953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d520a-8bd1-47c1-a614-b3a5519696e3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:31.590242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d520a-8bd1-47c1-a614-b3a5519696e3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:31.590516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d520a-8bd1-47c1-a614-b3a5519696e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:31.665318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ae9d520a-8bd1-47c1-a614-b3a5519696e3 None None] MFA Rules not processed for user `a758c6680078465d8d65ffd105594530`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:31.666528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ae9d520a-8bd1-47c1-a614-b3a5519696e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:31.687187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:31.742465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 735/1474] 10.222.0.57 () {58 vars in 1063 bytes} [Mon Jul 25 08:37:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:31.750502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c828b-4a6d-4b92-9e08-4659be25e380 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:31.752024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6d6c828b-4a6d-4b92-9e08-4659be25e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:31.859787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c828b-4a6d-4b92-9e08-4659be25e380 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:31.935216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:31.935890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:31.936171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:31.936445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:31.938085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:31.992389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:32.048429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:32.049872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32c917-75a9-45ce-bdf5-47e6996dd4d1 service glance] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:32.068364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 740/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:34.142080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13a7b2-4dd4-4efa-b85c-b7f95b31f7cd None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:34.142608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13a7b2-4dd4-4efa-b85c-b7f95b31f7cd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:34.142608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13a7b2-4dd4-4efa-b85c-b7f95b31f7cd None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:34.144006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 736/1476] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:34.149244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da7ac-281e-49dd-8d67-76183ef4ce82 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:34.149682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da7ac-281e-49dd-8d67-76183ef4ce82 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:34.149805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da7ac-281e-49dd-8d67-76183ef4ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:34.215446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-622da7ac-281e-49dd-8d67-76183ef4ce82 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:34.216650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-622da7ac-281e-49dd-8d67-76183ef4ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:34.312240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 741/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:34.334335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13a7b2-4dd4-4efa-b85c-b7f95b31f7cd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:34.335878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2a13a7b2-4dd4-4efa-b85c-b7f95b31f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:34.462821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13a7b2-4dd4-4efa-b85c-b7f95b31f7cd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:34.511156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:34.557598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:34.558251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:34.558529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:34.558804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:34.559566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:34.561292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:37:34.561292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:37:34.561292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:37:34.562476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b799d1-a0b6-400d-ba36-e3381795d80f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:34.580760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 737/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Jul 25 08:37:34 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:37:36.570786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d8f0-9189-42e9-9c5d-527402cdf47f None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:36.571286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d8f0-9189-42e9-9c5d-527402cdf47f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:36.571435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d8f0-9189-42e9-9c5d-527402cdf47f None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:36.572750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 742/1479] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:36.578531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f5617-4c32-4a28-b562-f7cf532be336 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:36.578957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f5617-4c32-4a28-b562-f7cf532be336 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:36.579088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f5617-4c32-4a28-b562-f7cf532be336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:36.644641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bd8f5617-4c32-4a28-b562-f7cf532be336 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:36.645825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bd8f5617-4c32-4a28-b562-f7cf532be336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:36.742527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 738/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:36.786188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281d8f0-9189-42e9-9c5d-527402cdf47f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:36.788464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2281d8f0-9189-42e9-9c5d-527402cdf47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:36.799056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:36.932772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281d8f0-9189-42e9-9c5d-527402cdf47f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:37.010715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:37.044347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:37.044998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:37.045283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:37.045560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:37.047212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:37.134759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:37.136909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f64bc7-f551-4a0a-808c-71f46c56c670 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:37.155036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 743/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:39.325074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea4be-c861-40b4-8b0f-c595afe2b00b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:39.325645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea4be-c861-40b4-8b0f-c595afe2b00b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:39.325645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea4be-c861-40b4-8b0f-c595afe2b00b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:39.326994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 739/1482] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:37:39.332260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146865-fc06-4320-ad83-5f419f87b627 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:39.332690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146865-fc06-4320-ad83-5f419f87b627 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:39.332873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146865-fc06-4320-ad83-5f419f87b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:39.398357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-40146865-fc06-4320-ad83-5f419f87b627 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:39.399600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-40146865-fc06-4320-ad83-5f419f87b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:39.446723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:39.497410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 744/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:39.532572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcea4be-c861-40b4-8b0f-c595afe2b00b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:39.534214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0dcea4be-c861-40b4-8b0f-c595afe2b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:39.558935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:39.637531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcea4be-c861-40b4-8b0f-c595afe2b00b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:39.709498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:39.710151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:39.710444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:39.710724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:39.712409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:39.787254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:39.822078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:39.823580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd66b-94a5-47da-b263-751fb5576b4f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:39.841852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 740/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:41.883193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e158e-4ab7-4030-8959-8a42642e9b42 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:41.883733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e158e-4ab7-4030-8959-8a42642e9b42 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:41.883733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e158e-4ab7-4030-8959-8a42642e9b42 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:41.885148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 745/1485] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:41.890411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057ebc-b78e-461c-82c1-c8e52f011e63 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:41.890870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057ebc-b78e-461c-82c1-c8e52f011e63 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:41.890975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057ebc-b78e-461c-82c1-c8e52f011e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:41.956085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8d057ebc-b78e-461c-82c1-c8e52f011e63 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:41.957321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8d057ebc-b78e-461c-82c1-c8e52f011e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:42.058222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 741/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:42.095957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e158e-4ab7-4030-8959-8a42642e9b42 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:42.097689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d65e158e-4ab7-4030-8959-8a42642e9b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:42.200152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e158e-4ab7-4030-8959-8a42642e9b42 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:42.272487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:42.274238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:42.274889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:42.275369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:42.275840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:42.278192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:42.384270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:42.386232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c75c57-850a-4662-90e4-89574786ad74 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:42.404258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 746/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:44.537594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4ccb-acc1-4aea-8b5d-82c0dbab64b4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:44.538400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4ccb-acc1-4aea-8b5d-82c0dbab64b4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:44.538745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4ccb-acc1-4aea-8b5d-82c0dbab64b4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:44.540167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 742/1488] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:44.546038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec775-483e-49a8-90c8-524a27c5a2c3 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:44.546504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec775-483e-49a8-90c8-524a27c5a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:44.546622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec775-483e-49a8-90c8-524a27c5a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:44.611769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-000ec775-483e-49a8-90c8-524a27c5a2c3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:44.612973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-000ec775-483e-49a8-90c8-524a27c5a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:44.665259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:44.709340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 747/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:44.750708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed4ccb-acc1-4aea-8b5d-82c0dbab64b4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:44.752255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c1ed4ccb-acc1-4aea-8b5d-82c0dbab64b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:44.788650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:44.857636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed4ccb-acc1-4aea-8b5d-82c0dbab64b4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:44.930787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:44.931460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:44.931751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:44.932031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:44.933713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:45.013109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:45.046487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:45.048000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b45d-1157-4b85-a3d0-e5afd97a3605 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:45.067947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 743/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:47.283519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4c65-0542-41fc-a9a1-0e4fb11be145 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:47.284081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4c65-0542-41fc-a9a1-0e4fb11be145 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:47.284081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4c65-0542-41fc-a9a1-0e4fb11be145 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:47.285512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 748/1491] 10.222.0.57 () {54 vars in 926 bytes} [Mon Jul 25 08:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:37:47.290939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceedca1-4ab6-4932-8a4e-5fc6eb050ce1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:47.291366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceedca1-4ab6-4932-8a4e-5fc6eb050ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:47.291536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceedca1-4ab6-4932-8a4e-5fc6eb050ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:47.356905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fceedca1-4ab6-4932-8a4e-5fc6eb050ce1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:37:47.358119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fceedca1-4ab6-4932-8a4e-5fc6eb050ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:47.454106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 744/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Jul 25 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:37:47.492436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4c65-0542-41fc-a9a1-0e4fb11be145 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:37:47.493972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-dd6e4c65-0542-41fc-a9a1-0e4fb11be145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:47.599074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4c65-0542-41fc-a9a1-0e4fb11be145 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:37:47.670404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:37:47.671044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:37:47.671323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:37:47.671624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:37:47.673244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:37:47.682125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:47.780816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:37:47.782261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448afb9d-9592-4db0-8e6b-1183bacf56e6 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:37:47.800673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 749/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:37:57.452108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=82 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:37:57.798333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=50 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:14.443933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:14.444502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:14.444502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:14.518000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:39:14.519480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:14.621397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 745/1494] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:39:14.629459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:14.629959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:14.630063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:14.704491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:39:14.705632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:14.805182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 750/1495] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:39:14.809791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:14.810996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:14.822921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37d4fe-a531-4a28-b1b0-1babda446c0f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:14.884888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:14.919101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:14.919794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:14.920074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:14.920346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:14.921065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:39:14.921367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:14.922378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:14.922378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:39:14.922378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:39:14.923262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:14.934382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 746/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:39:14.943734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:14.953183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b11e1-4079-40c8-a528-ae7cdc95c92a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:15.014402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:15.050033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:15.051031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.051326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.051769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.052600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:15.054665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:15.054665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:39:15.054665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:39:15.055906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:15.111482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 751/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:39:14 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:39:15.115671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:15.117715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:15.152130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774545-0232-4b71-9b06-b13ec53bc4a9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:15.243841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:15.244505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.244786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.245058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.245749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:15.246762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:15.246762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:39:15.246762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:39:15.247998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:15.289442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 747/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:39:15 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:39:15.293715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:15.295240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:15.358339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a40f6-bb98-4d05-9474-3e7dd00dce07 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:15.440852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:15.453006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:15.453671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.453952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.454226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.454951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:15.455997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:15.455997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:39:15.455997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:39:15.456911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:15.469194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 752/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:39:15.473269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:15.474794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:15.486700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba6517-180b-42eb-bc20-4a91dc8912ef admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:15.512096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:15.584543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:15.585246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.585529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.585813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.586546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:15.587602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:15.587602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:39:15.587602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:39:15.588495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebedc8-2dd9-48ed-9733-7aa3128b97ab admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:15.601452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 748/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:39:15.605794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:15.607311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:15.640178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadfbe8-5b0d-4c81-81f3-195c8f905d26 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:15.733392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:15.734286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.734582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.734855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] PATH_INFO: `/v3/projects/e4498a264b23409a813d2fa62cf8eb43/users/22fd961005eb480a9946673e42cc087e/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.760634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4498a264b23409a813d2fa62cf8eb43, user_id=22fd961005eb480a9946673e42cc087e, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:15.761667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:15.761667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:39:15.761667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:39:15.763681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a63c-6878-465e-abd2-ca579a5a2922 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:15.787306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 753/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:39:15 2022] PUT /identity/v3/projects/e4498a264b23409a813d2fa62cf8eb43/users/22fd961005eb480a9946673e42cc087e/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:39:15.799893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ec72-936e-4203-b61d-f35e83cdcc5a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.800207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ec72-936e-4203-b61d-f35e83cdcc5a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.800489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ec72-936e-4203-b61d-f35e83cdcc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.857625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2983ec72-936e-4203-b61d-f35e83cdcc5a None None] MFA Rules not processed for user `22fd961005eb480a9946673e42cc087e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:39:15.858768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2983ec72-936e-4203-b61d-f35e83cdcc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:15.935031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 749/1502] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:39:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:39:15.948158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bf707-b592-49e4-a2fe-f50f9a294fe5 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.948456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bf707-b592-49e4-a2fe-f50f9a294fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.948738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bf707-b592-49e4-a2fe-f50f9a294fe5 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.950119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 754/1503] 10.222.0.57 () {54 vars in 964 bytes} [Mon Jul 25 08:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:39:15.955042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23577ad5-67b4-464e-8057-71eb3899ab30 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:15.955329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23577ad5-67b4-464e-8057-71eb3899ab30 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:15.955635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23577ad5-67b4-464e-8057-71eb3899ab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:15.987176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:16.031352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-23577ad5-67b4-464e-8057-71eb3899ab30 None None] MFA Rules not processed for user `0a6925d9c52e4bf9ab900755b8aac7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:39:16.032598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-23577ad5-67b4-464e-8057-71eb3899ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:16.107305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 750/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Mon Jul 25 08:39:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:39:16.115151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bf707-b592-49e4-a2fe-f50f9a294fe5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:16.116683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-501bf707-b592-49e4-a2fe-f50f9a294fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:16.165960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:16.220597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bf707-b592-49e4-a2fe-f50f9a294fe5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:16.293531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:16.294153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:16.294434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:16.294705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:16.296353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:16.393121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:16.394459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:16.398533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:16.413234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 755/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:39:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:39:16.458511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b512-67cf-420c-b488-e9d9c3c6cb60 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:16.458824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b512-67cf-420c-b488-e9d9c3c6cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:16.459107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b512-67cf-420c-b488-e9d9c3c6cb60 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:16.461059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 751/1506] 10.222.0.57 () {52 vars in 830 bytes} [Mon Jul 25 08:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:39:16.464614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:16.465810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:16.563486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02d3a3-96c6-45ee-b90e-02f5581340ce service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:16.660378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:16.661193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:16.661471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:16.661740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] PATH_INFO: `/v3/users/22fd961005eb480a9946673e42cc087e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:16.673858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22fd961005eb480a9946673e42cc087e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:16.674883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:16.674883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:39:16.674883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:39:16.676133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:16.686452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:16.739416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22fd961005eb480a9946673e42cc087e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:16.740197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22fd961005eb480a9946673e42cc087e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:16.740622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22fd961005eb480a9946673e42cc087e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:16.760035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22fd961005eb480a9946673e42cc087e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:16.771844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22fd961005eb480a9946673e42cc087e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:16.787894 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 756/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:39:16 2022] DELETE /identity/v3/users/22fd961005eb480a9946673e42cc087e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:39:16.792331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:16.792799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:16.792895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:16.850198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:39:16.851702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:16.934162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:16.948468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 752/1508] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:39:16.958537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:16.959800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:17.058146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8acb6-2f3b-46aa-b407-e5fb60eac0f4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:17.111461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:17.132296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:17.132941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:17.133224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:17.133498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:17.135129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:17.242091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:17.243546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667debbc-bdaf-4eec-8bc4-485e7a13f7b2 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:17.261529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 757/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:39:17.581487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:39:17.582718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:39:17.594564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a21e27-21e3-466b-9004-f1894f40fac8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:39:17.690888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:39:17.691773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:39:17.692055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:39:17.692324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] PATH_INFO: `/v3/projects/e4498a264b23409a813d2fa62cf8eb43` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:39:17.702036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4498a264b23409a813d2fa62cf8eb43)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:39:17.703053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:39:17.703053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:39:17.703053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:39:17.704275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:39:17.761348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4498a264b23409a813d2fa62cf8eb43', 'request_id': 'req-35b49508-33a8-4e59-9392-461414ee7cdd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:17.771226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4498a264b23409a813d2fa62cf8eb43', 'request_id': 'req-35b49508-33a8-4e59-9392-461414ee7cdd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:17.777887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4498a264b23409a813d2fa62cf8eb43', 'request_id': 'req-35b49508-33a8-4e59-9392-461414ee7cdd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:17.808578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] The token cache is being invalidate because project e4498a264b23409a813d2fa62cf8eb43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:39:17.809153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:17.809264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-35b49508-33a8-4e59-9392-461414ee7cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:39:17.810590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 753/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:39:17 2022] DELETE /identity/v3/projects/e4498a264b23409a813d2fa62cf8eb43 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:39:27.259068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=62 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:27.806223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:03.942146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ac9f-a4ab-4d70-be13-21dc0f2ea912 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:03.942719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ac9f-a4ab-4d70-be13-21dc0f2ea912 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:03.942719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ac9f-a4ab-4d70-be13-21dc0f2ea912 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:03.944051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:03.948838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca73ef-118e-4bdc-b62e-857ebe7609b6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:03.949238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca73ef-118e-4bdc-b62e-857ebe7609b6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:03.949404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca73ef-118e-4bdc-b62e-857ebe7609b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:04.029750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a7ca73ef-118e-4bdc-b62e-857ebe7609b6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:04.030960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a7ca73ef-118e-4bdc-b62e-857ebe7609b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:04.134003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:04.292403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ac9f-a4ab-4d70-be13-21dc0f2ea912 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:04.294491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f4e5ac9f-a4ab-4d70-be13-21dc0f2ea912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:04.414081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ac9f-a4ab-4d70-be13-21dc0f2ea912 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:04.419697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f0ea1-1081-4a3b-bf89-5edd24f42553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:04.420341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0ea1-1081-4a3b-bf89-5edd24f42553 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:04.420626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0ea1-1081-4a3b-bf89-5edd24f42553 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:04.420905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0ea1-1081-4a3b-bf89-5edd24f42553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:04.428944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f0ea1-1081-4a3b-bf89-5edd24f42553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:04.430529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f0ea1-1081-4a3b-bf89-5edd24f42553 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:04.440554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 759/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:05.263485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe4ce-f2b6-424d-89da-006b138d05a9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:05.264057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe4ce-f2b6-424d-89da-006b138d05a9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:05.264057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe4ce-f2b6-424d-89da-006b138d05a9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:05.265421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:05.270253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2a73b-6e37-4abd-bac9-9826cee4cf30 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:05.270654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2a73b-6e37-4abd-bac9-9826cee4cf30 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:05.270821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2a73b-6e37-4abd-bac9-9826cee4cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:05.290461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8ee2a73b-6e37-4abd-bac9-9826cee4cf30 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:05.292308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8ee2a73b-6e37-4abd-bac9-9826cee4cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:05.300171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:05.450663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe4ce-f2b6-424d-89da-006b138d05a9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:05.467358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe4ce-f2b6-424d-89da-006b138d05a9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:05.472983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8aa8b-9723-4b31-bde1-7d95f2678b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:05.473623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8aa8b-9723-4b31-bde1-7d95f2678b8d service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:05.473909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8aa8b-9723-4b31-bde1-7d95f2678b8d service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:05.474190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8aa8b-9723-4b31-bde1-7d95f2678b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:05.483771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8aa8b-9723-4b31-bde1-7d95f2678b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:05.485366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8aa8b-9723-4b31-bde1-7d95f2678b8d service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:05.494875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 756/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:06.007663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0d7b-8061-43d2-8cd9-cdb190333857 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:06.007956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0d7b-8061-43d2-8cd9-cdb190333857 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:06.008238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0d7b-8061-43d2-8cd9-cdb190333857 None None] PATH_INFO: `/v3` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:06.010296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 761/1517] 10.222.0.61 () {54 vars in 925 bytes} [Mon Jul 25 08:41:06 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:41:06.017308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ee54-bf1f-4d07-801c-0d1279c361a8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:06.017593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ee54-bf1f-4d07-801c-0d1279c361a8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:06.017877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ee54-bf1f-4d07-801c-0d1279c361a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:06.076649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-24c3ee54-bf1f-4d07-801c-0d1279c361a8 None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:06.077863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-24c3ee54-bf1f-4d07-801c-0d1279c361a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:06.094833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:06.153628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 757/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Jul 25 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:10.106367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f9e22-7521-4ff9-9a8f-9e48ebe9a8a1 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:10.106821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f9e22-7521-4ff9-9a8f-9e48ebe9a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:10.106925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f9e22-7521-4ff9-9a8f-9e48ebe9a8a1 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:10.108354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 762/1519] 10.222.0.57 () {54 vars in 961 bytes} [Mon Jul 25 08:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:10.113736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2651-4705-4ecf-aa4f-fdbdbf7f97da None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:10.114167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2651-4705-4ecf-aa4f-fdbdbf7f97da None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:10.114319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2651-4705-4ecf-aa4f-fdbdbf7f97da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:10.135145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e4cb2651-4705-4ecf-aa4f-fdbdbf7f97da None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:10.136393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e4cb2651-4705-4ecf-aa4f-fdbdbf7f97da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:10.144980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 758/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Jul 25 08:41:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:10.152398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f9e22-7521-4ff9-9a8f-9e48ebe9a8a1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:10.167037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f9e22-7521-4ff9-9a8f-9e48ebe9a8a1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:10.173236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a709-20f9-453e-ba07-ff5d5eed727f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:10.173873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a709-20f9-453e-ba07-ff5d5eed727f service placement] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:10.174138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a709-20f9-453e-ba07-ff5d5eed727f service placement] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:10.174472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a709-20f9-453e-ba07-ff5d5eed727f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:10.184001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a709-20f9-453e-ba07-ff5d5eed727f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:10.185581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a709-20f9-453e-ba07-ff5d5eed727f service placement] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:10.195211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 763/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:41:16.710195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a6f15-a915-4733-8794-8cc6003b3e5f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:16.710760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a6f15-a915-4733-8794-8cc6003b3e5f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:16.710760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a6f15-a915-4733-8794-8cc6003b3e5f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:16.712129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:16.717365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283f8d-9cc2-47fc-9179-86b484dd9025 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:16.717747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283f8d-9cc2-47fc-9179-86b484dd9025 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:16.717925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283f8d-9cc2-47fc-9179-86b484dd9025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:16.737627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d9283f8d-9cc2-47fc-9179-86b484dd9025 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:16.738810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d9283f8d-9cc2-47fc-9179-86b484dd9025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:16.746579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:16.898897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a6f15-a915-4733-8794-8cc6003b3e5f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:16.913538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a6f15-a915-4733-8794-8cc6003b3e5f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:16.918818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80218ea7-5e36-491f-ac96-9e2be12be928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:16.919479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218ea7-5e36-491f-ac96-9e2be12be928 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:16.919762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218ea7-5e36-491f-ac96-9e2be12be928 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:16.920035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218ea7-5e36-491f-ac96-9e2be12be928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:16.927944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80218ea7-5e36-491f-ac96-9e2be12be928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:16.929525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80218ea7-5e36-491f-ac96-9e2be12be928 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:16.938754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 760/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:17.766452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427ecc7-b810-4233-bce3-5866761930a4 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:17.767085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427ecc7-b810-4233-bce3-5866761930a4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:17.767085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427ecc7-b810-4233-bce3-5866761930a4 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:17.768451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:17.773260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466be88-1b4e-42fa-a83b-70168fc296cf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:17.773699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466be88-1b4e-42fa-a83b-70168fc296cf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:17.773797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466be88-1b4e-42fa-a83b-70168fc296cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:17.793363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9466be88-1b4e-42fa-a83b-70168fc296cf None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:17.794584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9466be88-1b4e-42fa-a83b-70168fc296cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:17.802363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:17.954297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427ecc7-b810-4233-bce3-5866761930a4 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:17.968273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427ecc7-b810-4233-bce3-5866761930a4 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:17.973577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93844-3795-4692-ae5a-474092e058f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:17.974452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93844-3795-4692-ae5a-474092e058f7 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:17.974984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93844-3795-4692-ae5a-474092e058f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:17.975271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93844-3795-4692-ae5a-474092e058f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:17.983284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93844-3795-4692-ae5a-474092e058f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:17.984888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93844-3795-4692-ae5a-474092e058f7 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:17.994616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 766/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:21.880444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1829d1-af0a-4eb5-b7c4-5bda8d78e173 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:21.880982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1829d1-af0a-4eb5-b7c4-5bda8d78e173 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:21.880982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1829d1-af0a-4eb5-b7c4-5bda8d78e173 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:21.882367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:21.888171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646fce6-c4d7-4874-8790-8db033e54e81 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:21.888575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646fce6-c4d7-4874-8790-8db033e54e81 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:21.888729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646fce6-c4d7-4874-8790-8db033e54e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:21.908719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6646fce6-c4d7-4874-8790-8db033e54e81 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:21.909897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6646fce6-c4d7-4874-8790-8db033e54e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:21.917637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:21.988566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1829d1-af0a-4eb5-b7c4-5bda8d78e173 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:21.990243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fb1829d1-af0a-4eb5-b7c4-5bda8d78e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:22.068736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1829d1-af0a-4eb5-b7c4-5bda8d78e173 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:22.072322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34c55b-686b-4473-b03e-9730bbd61be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:22.072963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34c55b-686b-4473-b03e-9730bbd61be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:22.073242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34c55b-686b-4473-b03e-9730bbd61be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:22.073514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34c55b-686b-4473-b03e-9730bbd61be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:22.082258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34c55b-686b-4473-b03e-9730bbd61be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:22.083733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34c55b-686b-4473-b03e-9730bbd61be7 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:22.094424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 763/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:24.161932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8fab1-322b-4134-a473-81807f8fa8e7 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:24.162441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8fab1-322b-4134-a473-81807f8fa8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:24.162560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8fab1-322b-4134-a473-81807f8fa8e7 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:24.163912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:24.169491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46177082-9998-4abf-97be-4ee02230eabc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:24.169891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46177082-9998-4abf-97be-4ee02230eabc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:24.170050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46177082-9998-4abf-97be-4ee02230eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:24.188565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-46177082-9998-4abf-97be-4ee02230eabc None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:24.189747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-46177082-9998-4abf-97be-4ee02230eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:24.197560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:24.234370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8fab1-322b-4134-a473-81807f8fa8e7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:24.236076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bed8fab1-322b-4134-a473-81807f8fa8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:24.249089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8fab1-322b-4134-a473-81807f8fa8e7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:24.252669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9215c-8ddc-4196-8a2e-ea7717f2eedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:24.253307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9215c-8ddc-4196-8a2e-ea7717f2eedc service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:24.253593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9215c-8ddc-4196-8a2e-ea7717f2eedc service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:24.253871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9215c-8ddc-4196-8a2e-ea7717f2eedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:24.262735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9215c-8ddc-4196-8a2e-ea7717f2eedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:24.264188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9215c-8ddc-4196-8a2e-ea7717f2eedc service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:24.273604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 769/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:27.960093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a22a-e5e3-4414-9148-041c9bebbed4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:27.960659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a22a-e5e3-4414-9148-041c9bebbed4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:27.960659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a22a-e5e3-4414-9148-041c9bebbed4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:27.962027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:27.967245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ad25-b016-4950-a9e6-561201d02fbd None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:27.967697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ad25-b016-4950-a9e6-561201d02fbd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:27.967876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ad25-b016-4950-a9e6-561201d02fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:27.975853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=81 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:27.988299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1684ad25-b016-4950-a9e6-561201d02fbd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:27.989490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1684ad25-b016-4950-a9e6-561201d02fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:27.997900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:28.318457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a22a-e5e3-4414-9148-041c9bebbed4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:28.320141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3776a22a-e5e3-4414-9148-041c9bebbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:28.388594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:28.402194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a22a-e5e3-4414-9148-041c9bebbed4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:28.405812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cfba0-11d5-484a-9ad3-2afe38c26132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:28.406460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cfba0-11d5-484a-9ad3-2afe38c26132 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:28.406744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cfba0-11d5-484a-9ad3-2afe38c26132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:28.407024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cfba0-11d5-484a-9ad3-2afe38c26132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:28.415887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cfba0-11d5-484a-9ad3-2afe38c26132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:28.417885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cfba0-11d5-484a-9ad3-2afe38c26132 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:28.427218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 766/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:30.431270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9c008-c054-4b3f-acfd-cbd4e8144a72 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:30.431818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9c008-c054-4b3f-acfd-cbd4e8144a72 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:30.431818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9c008-c054-4b3f-acfd-cbd4e8144a72 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:30.433731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:30.438911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b99de-528d-441d-a298-63ccf84a595a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:30.439343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b99de-528d-441d-a298-63ccf84a595a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:30.439513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b99de-528d-441d-a298-63ccf84a595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:30.458475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c05b99de-528d-441d-a298-63ccf84a595a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:30.459699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c05b99de-528d-441d-a298-63ccf84a595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:30.467447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:30.766244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9c008-c054-4b3f-acfd-cbd4e8144a72 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:30.767930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-02d9c008-c054-4b3f-acfd-cbd4e8144a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:30.781594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9c008-c054-4b3f-acfd-cbd4e8144a72 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:30.785073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4be6f-9e5c-4697-ba9c-c529ea4347fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:30.785702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4be6f-9e5c-4697-ba9c-c529ea4347fb service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:30.785984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4be6f-9e5c-4697-ba9c-c529ea4347fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:30.786388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4be6f-9e5c-4697-ba9c-c529ea4347fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:30.795898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4be6f-9e5c-4697-ba9c-c529ea4347fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:30.797314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4be6f-9e5c-4697-ba9c-c529ea4347fb service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:30.806573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 772/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:40.453462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=11 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:40.802433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=8 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:06.595594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.596725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.597275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.643011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:06.644251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:06.662300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 768/1540] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:06.671815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.672800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.673302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.701975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:06.703580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:06.719272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 773/1541] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:06.724188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:06.741098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ceef-45a8-4d2c-b96f-06f26fe882ed None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:06.748567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:06.749249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.749797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.750297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.751251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:06.751816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:06.753642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcd1f8-93d6-4064-8fb8-d44c47d105dd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:06.776795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 769/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:06.784901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:06.797735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332daaf-da36-4479-a78d-eb2ae93bc55c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:06.812506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7fde7-ec4c-4c44-a9ce-287ce103e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:06.813132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7fde7-ec4c-4c44-a9ce-287ce103e987 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.813422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7fde7-ec4c-4c44-a9ce-287ce103e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.813701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7fde7-ec4c-4c44-a9ce-287ce103e987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.814424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7fde7-ec4c-4c44-a9ce-287ce103e987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:06.816509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7fde7-ec4c-4c44-a9ce-287ce103e987 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:06.831136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750933e-93ba-44d3-b1fb-c79684626a23 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.832207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750933e-93ba-44d3-b1fb-c79684626a23 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.832747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750933e-93ba-44d3-b1fb-c79684626a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.861650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8750933e-93ba-44d3-b1fb-c79684626a23 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:06.863427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8750933e-93ba-44d3-b1fb-c79684626a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:06.876052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 770/1543] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:06.877216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b87736-9908-43c6-adeb-a9fa488bf8ce None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.878353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b87736-9908-43c6-adeb-a9fa488bf8ce None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.878803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b87736-9908-43c6-adeb-a9fa488bf8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.882558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 774/1544] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:06.884676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2769c-cd51-4881-b87e-aa06201b1bad None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.885155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2769c-cd51-4881-b87e-aa06201b1bad None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.885607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2769c-cd51-4881-b87e-aa06201b1bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:06.907071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-95b87736-9908-43c6-adeb-a9fa488bf8ce None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:06.907071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-95b87736-9908-43c6-adeb-a9fa488bf8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:06.921979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ede2769c-cd51-4881-b87e-aa06201b1bad None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:06.923572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ede2769c-cd51-4881-b87e-aa06201b1bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:06.979597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 771/1545] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:06.980671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679c67-3c56-4204-9ff2-0aa9bf2d498a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:06.980963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679c67-3c56-4204-9ff2-0aa9bf2d498a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:06.981243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679c67-3c56-4204-9ff2-0aa9bf2d498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.001667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 775/1546] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.002962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.003256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.003572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.004408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0e679c67-3c56-4204-9ff2-0aa9bf2d498a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.005920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e679c67-3c56-4204-9ff2-0aa9bf2d498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.022631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 772/1547] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.022631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94830860-15e5-447e-a3fc-c6cfe695d030 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.022631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94830860-15e5-447e-a3fc-c6cfe695d030 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.022631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94830860-15e5-447e-a3fc-c6cfe695d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.023604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.024717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.033665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 776/1548] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.034424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.036933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-94830860-15e5-447e-a3fc-c6cfe695d030 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.038112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-94830860-15e5-447e-a3fc-c6cfe695d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.043967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423014f-9516-4ee6-9523-ec1f816d1edd None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.046865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 773/1549] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.048104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1dac7-ad9b-446b-a26d-d9014063dca9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.048393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1dac7-ad9b-446b-a26d-d9014063dca9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.048644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.048779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1dac7-ad9b-446b-a26d-d9014063dca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.049301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.049588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.049863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.050682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.051591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:07.051591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:43:07.051591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:43:07.052783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1fe2d-282c-40c5-af8c-f2c9b20bb8c0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.068279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f9e1dac7-ad9b-446b-a26d-d9014063dca9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.069538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f9e1dac7-ad9b-446b-a26d-d9014063dca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.075917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 777/1550] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.077169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206f08c-6297-44b5-8598-230280353686 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.077461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206f08c-6297-44b5-8598-230280353686 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.077739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206f08c-6297-44b5-8598-230280353686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.078395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 774/1551] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.079466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3c6f4-4ba7-4161-9ae2-b63d3997e6b0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.079829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3c6f4-4ba7-4161-9ae2-b63d3997e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.080117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3c6f4-4ba7-4161-9ae2-b63d3997e6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.097271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c206f08c-6297-44b5-8598-230280353686 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.098523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c206f08c-6297-44b5-8598-230280353686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.100276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a4c3c6f4-4ba7-4161-9ae2-b63d3997e6b0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.101426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a4c3c6f4-4ba7-4161-9ae2-b63d3997e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.106721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 778/1552] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.107955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946787-0edd-4e0b-b451-39ce71630c91 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.108245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946787-0edd-4e0b-b451-39ce71630c91 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.108522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946787-0edd-4e0b-b451-39ce71630c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.109908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 775/1553] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.111029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.111328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.111636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.129062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6c946787-0edd-4e0b-b451-39ce71630c91 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.130259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6c946787-0edd-4e0b-b451-39ce71630c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.131479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.132623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.138903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 779/1554] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.140006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.140291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.140568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.144287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 776/1555] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.148723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.159175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d4c7-985e-4cf5-a469-e35135f3ecd6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.162015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.163919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.164055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.164826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.165110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.165383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.166187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.166494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.168945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef418f-2d6b-4249-a7d5-3c100b38c74d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.173532 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 780/1556] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.174346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.182058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 777/1557] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.183446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968dcf-41ae-46b9-a98d-029446e1b4fd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.183735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968dcf-41ae-46b9-a98d-029446e1b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.184008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968dcf-41ae-46b9-a98d-029446e1b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.184577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e6744-94ed-484c-a264-43a3d0d528be None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.189370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.190023 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.190307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.190582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.191310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.192948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.203099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b3968dcf-41ae-46b9-a98d-029446e1b4fd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.203486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 781/1558] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:07.204384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b3968dcf-41ae-46b9-a98d-029446e1b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.206937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.212499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 778/1559] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.213698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.213983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.214255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.217677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd0663-2e09-49a5-a9e6-21e632cedcbf admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.222641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.223290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.223606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.223887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.224612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.225188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.226204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:07.226204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:43:07.226204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:43:07.227095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.233360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.234531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.246095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 782/1560] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.246095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.246516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 779/1561] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.246516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.255315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3b4f-0e2f-4e47-830f-9392d021b046 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.255538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadf0b-1cb4-48cb-b375-140fcfbbb571 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.260285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.260696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.260923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.261204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.261327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.261476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.261607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.261884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.262188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.262490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.262591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.262898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.264104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.264522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.276127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 783/1562] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.276464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 780/1563] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.277124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.277254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.286732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c15a4-e015-4840-b1f8-05eda1b6cb9d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.291783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.292505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.292791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.293069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.293824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.294131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.295176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eccf3-1e5e-49c0-9a87-b7930356add6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.295827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.299805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.300443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.300723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.300997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.301675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.302677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:07.302677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:43:07.302677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:43:07.303997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.308706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 784/1564] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.309490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.319046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdbf92-babb-4656-8062-e865c57b410e admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.324202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.324844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.325174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.325405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.326295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.327963 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.339102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 785/1565] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:07.340048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.342961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 781/1566] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.343938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.350266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ac872-79b8-4ecc-b43b-477f98f54862 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.362567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:07.387978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:07.408642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0968e-208b-4801-979a-4fc59d5327a9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.409091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.409745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.410085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.410300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.411018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.411320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.412950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.413333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.413991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.414279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.414554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.415279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:07.416132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.417730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.433005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 786/1567] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.433005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.436438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1961-edda-41a5-848c-56eb160366fc admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.443478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 782/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:07.443478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.443699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.443699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.443699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.443699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.444069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.445564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.447724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf7e4-b339-4c96-b510-ba75f30fe725 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.452380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.453044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.453323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.453598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.454321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.456295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.477439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 787/1569] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.478860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.486208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 783/1570] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.487013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.547372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bff232-937c-478a-9c35-98bde46e81d4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.547690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc678-56a8-43a1-81d3-7c76cecefd16 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.552197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.552485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.552866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.553128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.553233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.553414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.553517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.553689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.554144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.554375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.556689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.557077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.584652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 784/1571] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 353 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.584851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 788/1572] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.585251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.585367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.649972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3985ae-85ad-4f1a-8d4e-ee14f214a3d7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.653798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c602-e928-48d3-b4d0-b2be3d992e51 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.654790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.655709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.655993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.656267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] PATH_INFO: `/v3/projects/0b249d5f8c134a9c9995d0f82544afb7/users/a2fd9d4ef85649c6ba75876e99df4f45/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.658650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.659313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.659649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.659932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.660621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.662603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.671261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b249d5f8c134a9c9995d0f82544afb7, user_id=a2fd9d4ef85649c6ba75876e99df4f45, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.672362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:07.672362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:43:07.672362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:43:07.674325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.684952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 789/1573] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.685893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.688665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 785/1574] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:07 2022] PUT /identity/v3/projects/0b249d5f8c134a9c9995d0f82544afb7/users/a2fd9d4ef85649c6ba75876e99df4f45/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:07.692288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.692561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:07.696492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35663-d3d0-4695-b6f6-3863315676bf admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.713531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:07.756671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1b56-df96-46d5-aa57-f5824f28f2ef admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.758732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.759597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.759887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.760219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.760916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.762240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.762993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.763200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.763672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.764179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.765488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.768260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.793554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 790/1575] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.794461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.802817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 786/1576] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.803746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.865346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0af9e-6df6-4c98-a9f2-536ad88a8998 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.869426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583b50-16cc-4716-805c-3e81f9441c50 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.870165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.870927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.871211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.871533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.872228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.874044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.874270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.874706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.874987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.875261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.875975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.877883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.896380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 791/1577] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.897056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.902252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 787/1578] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.903223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.911732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7277-4612-49da-bb69-715ec319592e admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.914805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974ff51-30af-4806-9950-09f2fa1f00e0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.917183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.917858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.918242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.918460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.919173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.920721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0289-f0c7-41c2-96bc-b4455b5f7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.921166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.921394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0289-f0c7-41c2-96bc-b4455b5f7282 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.921685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0289-f0c7-41c2-96bc-b4455b5f7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.921967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0289-f0c7-41c2-96bc-b4455b5f7282 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.922663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c0289-f0c7-41c2-96bc-b4455b5f7282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.924639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c0289-f0c7-41c2-96bc-b4455b5f7282 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.946364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 792/1579] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 277 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.946364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.947015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 788/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:07.948326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.948620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.948900 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.957141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d196c7-7f7d-4bc6-adb1-adbee12f0a86 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.962135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.963323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.963642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.963924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.964650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.966249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.968408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:07.969614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:07.977684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 793/1581] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:07.979043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.981501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 789/1582] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:07.982453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:07.988645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7f0e-525c-462a-971d-98f887bfa092 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.991876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0e58-0624-4214-abaa-f7573b41a610 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:07.993558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.994229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.994509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.994781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.995508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:07.996628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:07.997339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:07.997447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:07.997648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:07.997926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:07.998620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.000588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.019157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 794/1583] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 303 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:08.020079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.026233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 790/1584] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:07 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:08.026233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.030916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c66b2-3040-48e8-af69-4de8462187b7 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.034549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a970cb-42d5-4091-a913-45083edfb644 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.035648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.036314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.036625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.036889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.037618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.039216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.039921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.041302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.041590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.042211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.042939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.044552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.049828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 795/1585] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.050647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.058990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 791/1586] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.058990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.062000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff503b50-df1c-4b50-8554-e5cddc94bbad admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.067033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5175-d907-49ec-82e7-2140212d54c4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.067394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.068044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.068329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.068606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.069352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.070904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.071856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.072525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.072818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.073101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.073825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.075427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.081639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 796/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.082566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.090400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 792/1588] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.091199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.093003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaaf3-7d6a-4193-a52a-660ccb1576db admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.097727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.098391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.098658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.098935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.099959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.101551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.107763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:08.116688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 797/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.117507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.127132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52bbc3-4415-4f86-b572-47257ccddc30 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.129111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:08.132340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.132994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.133277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.133554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.135000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.136633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.149537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 798/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.149537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.153821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7148b76-5c5a-4127-9f8c-21bea05aea25 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.157514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.157666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890521-1296-462c-badf-0a2c104eeeaf admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.158153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.158429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.158698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.162514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.163228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.163451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.163739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.164464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.166107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.168322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.169936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.176592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 799/1591] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.177426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.179795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 793/1592] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:08.180625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.187340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdc260-8f3b-433d-bae3-15e296fef74b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.190021 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0893c5-73d0-4311-8357-8268d48a41b7 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.192468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.193108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.193394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.193669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.194398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.196065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.199937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.200602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.200886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.201160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.201934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.203510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.210680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 800/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.210680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.216508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 794/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.220447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.222330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6345d-3bd9-4381-9685-c158b1a7496d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.228331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.229314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.229900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.230516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.231353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fc963-f065-42be-8c7f-ebf13e02de64 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.231688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.233533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.236951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.237639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.237912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.238189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.238981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.240675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.246555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 801/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.247738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.256191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 795/1596] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.257299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.263190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622406-9f2c-4c0b-ad2a-f93bd645d040 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.268307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.269210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.269497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.269773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] PATH_INFO: `/v3/projects/37d6981c7d124e49966fa4c5fa49ed04/users/fb1e3c767d0e4d8c810376176384d99d/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.272618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e294-e59a-413b-b142-d7f6efe2d20d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.278291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.279013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.279369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.279650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.280432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.282285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.288249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d6981c7d124e49966fa4c5fa49ed04, user_id=fb1e3c767d0e4d8c810376176384d99d, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.292046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.294429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 796/1597] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.295487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.310813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fd80-f628-4bf9-a314-7af3b1bd8c23 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.312625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 802/1598] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/37d6981c7d124e49966fa4c5fa49ed04/users/fb1e3c767d0e4d8c810376176384d99d/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.313565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.396809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.397727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.397991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.398301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.399051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.401475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.402013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df87a61-0079-45e2-b3a9-05f9a174f20f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.411572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.412587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.412876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.413155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] PATH_INFO: `/v3/projects/05f759b303a94b1d886de71d5a834746/users/d9d24a461bf543148b3c0e45a9d2006f/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.417560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 797/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:08.417560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.428509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086f23-7e85-4fec-a994-d695f4eee91f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.431703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f759b303a94b1d886de71d5a834746, user_id=d9d24a461bf543148b3c0e45a9d2006f, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.433391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.434280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.434566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.434672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.434841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] PATH_INFO: `/v3/projects/566ed8d590cd478081bc174a783956cf/users/bd434ec0ff3649998b7daa1bfd4dd4b0/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.451788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 803/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/05f759b303a94b1d886de71d5a834746/users/d9d24a461bf543148b3c0e45a9d2006f/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.452750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.452965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=566ed8d590cd478081bc174a783956cf, user_id=bd434ec0ff3649998b7daa1bfd4dd4b0, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.455983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.475650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 798/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/566ed8d590cd478081bc174a783956cf/users/bd434ec0ff3649998b7daa1bfd4dd4b0/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.475650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.532297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb4de-d7b4-4ba2-932c-2d9f3f9828bf admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.558130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a2d5-29b8-4ed8-9a48-af6a1bed8c8a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.564339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.566023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.566378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.566725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] PATH_INFO: `/v3/projects/826953cb538c4085bac1aa3f01211ee1/users/27277c0a030844fbaa389f314fc9e3b3/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.569125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:08.592271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826953cb538c4085bac1aa3f01211ee1, user_id=27277c0a030844fbaa389f314fc9e3b3, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.596557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.600699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:08.624333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 799/1602] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/826953cb538c4085bac1aa3f01211ee1/users/27277c0a030844fbaa389f314fc9e3b3/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.624333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.635373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b307ce-54d9-42c6-9adc-e4f0c7b7e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.636463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b307ce-54d9-42c6-9adc-e4f0c7b7e325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.636581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b307ce-54d9-42c6-9adc-e4f0c7b7e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.637342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b307ce-54d9-42c6-9adc-e4f0c7b7e325 admin admin] PATH_INFO: `/v3/projects/84515aaea993411ab1b08b66152679d0/users/c10e6a7693974594bf7278498b4d18c2/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.652568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b307ce-54d9-42c6-9adc-e4f0c7b7e325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84515aaea993411ab1b08b66152679d0, user_id=c10e6a7693974594bf7278498b4d18c2, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.655424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b307ce-54d9-42c6-9adc-e4f0c7b7e325 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.670654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 804/1603] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/84515aaea993411ab1b08b66152679d0/users/c10e6a7693974594bf7278498b4d18c2/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.672291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.672585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.672865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.693879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:08.695099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:08.711849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df341dd-e4f1-422c-b2b7-b67be8d779b8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.774476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 805/1604] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:08.777038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.782730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9f534-1a97-44c2-a6a4-566072b5f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.783951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9f534-1a97-44c2-a6a4-566072b5f2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.784247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9f534-1a97-44c2-a6a4-566072b5f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.784497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9f534-1a97-44c2-a6a4-566072b5f2f1 admin admin] PATH_INFO: `/v3/projects/9c71d472c41c41b5a8cd88391d60e256/users/68ec6dcf8db04cc2bdbea439dc9d83fd/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.787786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02b92e-7088-4572-83f3-4e9df1b3d050 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.794797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060b15-91f0-4465-b95d-f8a8cd3a3d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.795813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060b15-91f0-4465-b95d-f8a8cd3a3d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.796467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060b15-91f0-4465-b95d-f8a8cd3a3d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.796755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060b15-91f0-4465-b95d-f8a8cd3a3d61 admin admin] PATH_INFO: `/v3/projects/22b265e17aaf4af7b3266238b2f60e34/users/5566f8271d714c0b8a5e6e2a9af37404/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.803030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9f534-1a97-44c2-a6a4-566072b5f2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c71d472c41c41b5a8cd88391d60e256, user_id=68ec6dcf8db04cc2bdbea439dc9d83fd, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.806849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9f534-1a97-44c2-a6a4-566072b5f2f1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.813352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060b15-91f0-4465-b95d-f8a8cd3a3d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b265e17aaf4af7b3266238b2f60e34, user_id=5566f8271d714c0b8a5e6e2a9af37404, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:08.816602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060b15-91f0-4465-b95d-f8a8cd3a3d61 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:08.825449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 800/1605] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/9c71d472c41c41b5a8cd88391d60e256/users/68ec6dcf8db04cc2bdbea439dc9d83fd/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.827214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6cd53-32cd-4784-9401-d05c5466c9fd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.827695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6cd53-32cd-4784-9401-d05c5466c9fd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.828126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6cd53-32cd-4784-9401-d05c5466c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.843779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 806/1606] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:08 2022] PUT /identity/v3/projects/22b265e17aaf4af7b3266238b2f60e34/users/5566f8271d714c0b8a5e6e2a9af37404/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:08.845667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7981e5-f9cd-4890-9995-0daa693a05ab None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.846100 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7981e5-f9cd-4890-9995-0daa693a05ab None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.846539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7981e5-f9cd-4890-9995-0daa693a05ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.854426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6ff6cd53-32cd-4784-9401-d05c5466c9fd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:08.855696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6ff6cd53-32cd-4784-9401-d05c5466c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:08.873994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9f7981e5-f9cd-4890-9995-0daa693a05ab None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:08.875473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9f7981e5-f9cd-4890-9995-0daa693a05ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:08.933945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 801/1607] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:08.937244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.937244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.937244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.965821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 807/1608] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:08.967044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea673b-4acf-4f54-983e-f049231b3c6a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.967345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea673b-4acf-4f54-983e-f049231b3c6a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.967660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea673b-4acf-4f54-983e-f049231b3c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.986685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] MFA Rules not processed for user `27277c0a030844fbaa389f314fc9e3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:08.988645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:09.007212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:09.007748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-41ea673b-4acf-4f54-983e-f049231b3c6a None None] MFA Rules not processed for user `c10e6a7693974594bf7278498b4d18c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:09.009289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-41ea673b-4acf-4f54-983e-f049231b3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:09.025686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:09.091327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 802/1609] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:09.091327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.113897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 808/1610] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:09.115379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.115808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.116164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.156197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] MFA Rules not processed for user `68ec6dcf8db04cc2bdbea439dc9d83fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:09.157421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:09.172662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec56db-4a70-41c0-8c88-22100557b862 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.176491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc39f8-cf59-4ccf-b014-0a70a9d11a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.177247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc39f8-cf59-4ccf-b014-0a70a9d11a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.177528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc39f8-cf59-4ccf-b014-0a70a9d11a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.177842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc39f8-cf59-4ccf-b014-0a70a9d11a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.189810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc39f8-cf59-4ccf-b014-0a70a9d11a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.191432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc39f8-cf59-4ccf-b014-0a70a9d11a91 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.202045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 803/1611] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:09.203143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.203453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.203730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.245055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 809/1612] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:09.246618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.259309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] MFA Rules not processed for user `5566f8271d714c0b8a5e6e2a9af37404`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:09.260347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74171-caf2-466a-8afe-28b82deb1273 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.260823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:09.264694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.265396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.265684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.265959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.280612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.282069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.295547 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 810/1613] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:09.296938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.307960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510369b-da65-4e6c-af6f-28a77344378f service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.313524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.314173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.314456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.314730 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.334642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.338003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.350736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 811/1614] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:09.359698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 804/1615] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:09.367958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.368185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.391008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531e13-48f1-4dbf-9f96-73e96b790267 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.406339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.406632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.406842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.407109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.407731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.414480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.469658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 805/1616] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:09.470960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.485808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427896c1-6832-42ff-a8f6-fd6fa2969a01 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.530672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:09.532708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:09.562400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.563149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.563520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.563803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.624431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9e76-fa72-42fc-8735-d9379bc07e46 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.638155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3b683-2a5c-401e-bcd8-597a88174d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.638840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b683-2a5c-401e-bcd8-597a88174d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.639122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b683-2a5c-401e-bcd8-597a88174d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.639623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b683-2a5c-401e-bcd8-597a88174d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.640333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3b683-2a5c-401e-bcd8-597a88174d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.646538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3b683-2a5c-401e-bcd8-597a88174d31 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.706216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 806/1617] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:09.708481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4145cf-7ea0-4dfd-ba64-64e14fdb11f9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.708775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4145cf-7ea0-4dfd-ba64-64e14fdb11f9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.709045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4145cf-7ea0-4dfd-ba64-64e14fdb11f9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.713134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.716146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 807/1618] 10.222.0.57 () {54 vars in 962 bytes} [Mon Jul 25 08:43:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:09.716982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4145cf-7ea0-4dfd-ba64-64e14fdb11f9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.719129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.742937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 812/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:09.744010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.767407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469de3e-af09-4f56-acb1-7a67a7ce8332 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.870267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4145cf-7ea0-4dfd-ba64-64e14fdb11f9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.881332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562729e0-fdd4-44d1-9613-12f49172b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.882015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562729e0-fdd4-44d1-9613-12f49172b69e admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.882297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562729e0-fdd4-44d1-9613-12f49172b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.882571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562729e0-fdd4-44d1-9613-12f49172b69e admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.883442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562729e0-fdd4-44d1-9613-12f49172b69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.885909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562729e0-fdd4-44d1-9613-12f49172b69e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.903226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.907536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.908219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.908843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.909856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.914176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.927998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 808/1620] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:09.930243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:09.931671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:09.932060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:09.966829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 813/1621] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:09.966829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:09.985860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815775c-2b74-44e5-9635-99642190142d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:09.998846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:09.999751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.000153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.000487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.011609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.018872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.032185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:10.035585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:10.045158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 814/1622] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:10.046154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.067712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6b4ad-e986-47f4-a3b7-f4762b2860dc admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.087087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.087987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.088369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.088743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.089579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.091284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.135648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 815/1623] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:10.137147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.156459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04055a0c-6967-4bbd-8c48-daf412addbfa admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.172835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.175264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.176647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.176647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] PATH_INFO: `/v3/projects/67b3ea150a39470293cf8089007fe49d/users/dbf6b865017247d7934dcd493291773f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.199994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 809/1624] 10.222.0.57 () {58 vars in 1059 bytes} [Mon Jul 25 08:43:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:10.201412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.213099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b3ea150a39470293cf8089007fe49d, user_id=dbf6b865017247d7934dcd493291773f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.215933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.225537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c95b-507c-4eeb-8fc9-82f1cd90c29f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.236839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.240188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.241701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.243023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] PATH_INFO: `/v3/projects/57d10dfcef7444a1b234b9ed064d75bf/users/bcb10c6b55d84da4b5e95c071eed70a5/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.244611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 816/1625] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:10 2022] PUT /identity/v3/projects/67b3ea150a39470293cf8089007fe49d/users/dbf6b865017247d7934dcd493291773f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:10.245529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.266429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d10dfcef7444a1b234b9ed064d75bf, user_id=bcb10c6b55d84da4b5e95c071eed70a5, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.285792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.341133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:10.341133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 810/1626] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:10 2022] PUT /identity/v3/projects/57d10dfcef7444a1b234b9ed064d75bf/users/bcb10c6b55d84da4b5e95c071eed70a5/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:10.341133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.365412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:10.488754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536166-4185-499f-b9cb-ccb2b8bc8063 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.546595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f05b-d627-4c14-ace4-a7265ebf1479 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.560851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.561465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.561869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.562261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.563612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.567049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.591469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 811/1627] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:10.593486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.619153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289162b-6e4d-4477-8605-48b74d18f3c2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.631988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.633395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.633793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.634218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.639183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.640095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.640372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.640735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.644542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.650026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.677955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 812/1628] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:10.683864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.708887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f736-0983-4b89-bbf6-db2ee0dfed8c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.721274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d371b1-03d7-4bdf-a5b1-9df3cd14b010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.722171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d371b1-03d7-4bdf-a5b1-9df3cd14b010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.722462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d371b1-03d7-4bdf-a5b1-9df3cd14b010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.722995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d371b1-03d7-4bdf-a5b1-9df3cd14b010 admin admin] PATH_INFO: `/v3/projects/67b3ea150a39470293cf8089007fe49d/users/dbf6b865017247d7934dcd493291773f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.732016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d371b1-03d7-4bdf-a5b1-9df3cd14b010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b3ea150a39470293cf8089007fe49d, user_id=dbf6b865017247d7934dcd493291773f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.735156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d371b1-03d7-4bdf-a5b1-9df3cd14b010 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.736335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.738072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.752459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 817/1629] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:10.753435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:10.767749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f623fcc-2d89-4b10-9fc7-42265a0fa1e0 service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:10.795802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 813/1630] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:10 2022] PUT /identity/v3/projects/67b3ea150a39470293cf8089007fe49d/users/dbf6b865017247d7934dcd493291773f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:10.806368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.806658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.806942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.884438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] MFA Rules not processed for user `dbf6b865017247d7934dcd493291773f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:10.885682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:10.921485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e67f0e-5780-43e7-9af5-b5223c070842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:10.924862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e67f0e-5780-43e7-9af5-b5223c070842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:10.925390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e67f0e-5780-43e7-9af5-b5223c070842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:10.925895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e67f0e-5780-43e7-9af5-b5223c070842 admin admin] PATH_INFO: `/v3/projects/57d10dfcef7444a1b234b9ed064d75bf/users/bcb10c6b55d84da4b5e95c071eed70a5/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:10.933335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e67f0e-5780-43e7-9af5-b5223c070842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d10dfcef7444a1b234b9ed064d75bf, user_id=bcb10c6b55d84da4b5e95c071eed70a5, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:10.944242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e67f0e-5780-43e7-9af5-b5223c070842 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:10.970927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:10.979108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 814/1631] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:10.992427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 818/1632] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:10 2022] PUT /identity/v3/projects/57d10dfcef7444a1b234b9ed064d75bf/users/bcb10c6b55d84da4b5e95c071eed70a5/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:11.002663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:11.004728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc818109-816c-4da8-81ff-d3d178fd7a14 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.005480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc818109-816c-4da8-81ff-d3d178fd7a14 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.005480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc818109-816c-4da8-81ff-d3d178fd7a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.109086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cc818109-816c-4da8-81ff-d3d178fd7a14 None None] MFA Rules not processed for user `bcb10c6b55d84da4b5e95c071eed70a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:11.117620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cc818109-816c-4da8-81ff-d3d178fd7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:11.148532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b00b62-46cc-4fa2-9737-51233faf36a1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:11.165116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:11.281508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:11.282181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.282469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.282749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.298501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 819/1633] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:11.300138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57cb39-6225-4440-82a2-fad19c6ce468 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.300432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57cb39-6225-4440-82a2-fad19c6ce468 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.300708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57cb39-6225-4440-82a2-fad19c6ce468 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.304215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 820/1634] 10.222.0.57 () {54 vars in 912 bytes} [Mon Jul 25 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:11.311649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57cb39-6225-4440-82a2-fad19c6ce468 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:11.342604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57cb39-6225-4440-82a2-fad19c6ce468 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:11.357567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee376fa-d0c7-4c68-9b49-8f3c8371cac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:11.358266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee376fa-d0c7-4c68-9b49-8f3c8371cac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.358557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee376fa-d0c7-4c68-9b49-8f3c8371cac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.358839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee376fa-d0c7-4c68-9b49-8f3c8371cac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.384650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee376fa-d0c7-4c68-9b49-8f3c8371cac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:11.386135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee376fa-d0c7-4c68-9b49-8f3c8371cac8 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:11.414378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:11.414940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 821/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:11.417451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:11.426152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.426437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.426726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.461940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:11.463374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:11.467403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 815/1636] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:11.684874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:11.695602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb588e30-5ad6-40b1-8bb7-7a33cd89f025 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:11.707894 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 822/1637] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:11.717050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:11.719054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:11.723160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.724301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.725432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.860878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:11.863510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:11.889438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 816/1638] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:11.891824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:11.905363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133f59c-3dd2-4181-9567-140d5a61ddfb service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:11.908264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340046a-c875-40fc-8893-a985aa3ae933 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:11.910581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d81f-2958-49a2-b2c6-649fe88ac64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:11.911549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d81f-2958-49a2-b2c6-649fe88ac64d service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.912305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d81f-2958-49a2-b2c6-649fe88ac64d service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.912970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d81f-2958-49a2-b2c6-649fe88ac64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.917380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:11.918291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.918575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.918849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] PATH_INFO: `/v3/users/68ec6dcf8db04cc2bdbea439dc9d83fd` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.920365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ec6dcf8db04cc2bdbea439dc9d83fd)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:11.922311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:11.927852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351d81f-2958-49a2-b2c6-649fe88ac64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:11.929865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:11.930939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351d81f-2958-49a2-b2c6-649fe88ac64d service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:11.947805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 817/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:12.066792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ec6dcf8db04cc2bdbea439dc9d83fd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:12.068645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ec6dcf8db04cc2bdbea439dc9d83fd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:12.070474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ec6dcf8db04cc2bdbea439dc9d83fd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:12.116526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ec6dcf8db04cc2bdbea439dc9d83fd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:12.141973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ec6dcf8db04cc2bdbea439dc9d83fd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:12.189658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f34594-6569-4b3a-b4bf-0d111a57565f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:12.189962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f34594-6569-4b3a-b4bf-0d111a57565f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:12.190371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f34594-6569-4b3a-b4bf-0d111a57565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:12.193692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 823/1640] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:11 2022] DELETE /identity/v3/users/68ec6dcf8db04cc2bdbea439dc9d83fd => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:12.262534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b4f34594-6569-4b3a-b4bf-0d111a57565f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:12.267780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b4f34594-6569-4b3a-b4bf-0d111a57565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:12.434006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:12.483927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 818/1641] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:12.500084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:12.501625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:12.662221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90346-21c6-4653-9472-05bb1fa76142 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:12.674486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1661b1-b71f-4b9c-8af1-daf8cb24de34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:12.676166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1661b1-b71f-4b9c-8af1-daf8cb24de34 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:12.678437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1661b1-b71f-4b9c-8af1-daf8cb24de34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:12.678892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1661b1-b71f-4b9c-8af1-daf8cb24de34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:12.708393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1661b1-b71f-4b9c-8af1-daf8cb24de34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:12.712762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1661b1-b71f-4b9c-8af1-daf8cb24de34 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:12.749213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 824/1642] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:12.998968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdedcc-2675-4b35-a894-4387d1b93993 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:12.999554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdedcc-2675-4b35-a894-4387d1b93993 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:12.999641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdedcc-2675-4b35-a894-4387d1b93993 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:13.001314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 819/1643] 10.222.0.57 () {54 vars in 962 bytes} [Mon Jul 25 08:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:13.012686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e96b-fd5e-4363-8d4e-2555b3e5105b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:13.013244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e96b-fd5e-4363-8d4e-2555b3e5105b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:13.013354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e96b-fd5e-4363-8d4e-2555b3e5105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:13.062370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4803e96b-fd5e-4363-8d4e-2555b3e5105b None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:13.072091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4803e96b-fd5e-4363-8d4e-2555b3e5105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:13.239713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 825/1644] 10.222.0.57 () {58 vars in 1059 bytes} [Mon Jul 25 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:13.245515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745cbce-a821-4cc0-a04b-f23153221071 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:13.246041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745cbce-a821-4cc0-a04b-f23153221071 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:13.246517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745cbce-a821-4cc0-a04b-f23153221071 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:13.248710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 820/1645] 10.222.0.57 () {54 vars in 912 bytes} [Mon Jul 25 08:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:13.254297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:13.255435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:13.255694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:13.296595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:13.298147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:13.310424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 826/1646] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:13.324579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745cbce-a821-4cc0-a04b-f23153221071 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:13.326967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4745cbce-a821-4cc0-a04b-f23153221071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:13.418210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745cbce-a821-4cc0-a04b-f23153221071 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:13.424497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:13.425449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:13.425900 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:13.426344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:13.450881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:13.452833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:13.479924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 821/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:14.034373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:14.036241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:14.061186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012f40d-c18e-4440-bfbe-97f543a14286 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:14.079604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:14.080683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:14.081073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:14.081451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] PATH_INFO: `/v3/projects/9c71d472c41c41b5a8cd88391d60e256` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:14.082959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c71d472c41c41b5a8cd88391d60e256)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:14.084150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: WARNING py.warnings [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:14.084150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: warnings.warn(msg) Jul 25 08:43:14.084150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: Jul 25 08:43:14.085815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:14.088802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:14.220509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c71d472c41c41b5a8cd88391d60e256', 'request_id': 'req-e160fedb-dbee-4f94-b883-da74dda86ea2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.235644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c71d472c41c41b5a8cd88391d60e256', 'request_id': 'req-e160fedb-dbee-4f94-b883-da74dda86ea2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.244478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c71d472c41c41b5a8cd88391d60e256', 'request_id': 'req-e160fedb-dbee-4f94-b883-da74dda86ea2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.284676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] The token cache is being invalidate because project 9c71d472c41c41b5a8cd88391d60e256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:14.286380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.287049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.288930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 827/1648] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:14 2022] DELETE /identity/v3/projects/9c71d472c41c41b5a8cd88391d60e256 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:14.293285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:14.313655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df34888-fe84-4db3-9fad-3a62915a85c3 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:14.469166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:14.471186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:14.471922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:14.473309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] PATH_INFO: `/v3/users/bcb10c6b55d84da4b5e95c071eed70a5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:14.481445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb10c6b55d84da4b5e95c071eed70a5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:14.487191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: WARNING py.warnings [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:14.487191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: warnings.warn(msg) Jul 25 08:43:14.487191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: Jul 25 08:43:14.490713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:14.630388 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb10c6b55d84da4b5e95c071eed70a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.631140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb10c6b55d84da4b5e95c071eed70a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.631793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb10c6b55d84da4b5e95c071eed70a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.658669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb10c6b55d84da4b5e95c071eed70a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.682148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-326ecc51-62c3-47bf-8117-fbdcc49661b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb10c6b55d84da4b5e95c071eed70a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:14.749170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 822/1649] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:14 2022] DELETE /identity/v3/users/bcb10c6b55d84da4b5e95c071eed70a5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:16.039764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:16.041960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:16.084085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fedb-dbee-4f94-b883-da74dda86ea2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:16.227577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:16.230929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:16.231496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:16.231995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] PATH_INFO: `/v3/users/5566f8271d714c0b8a5e6e2a9af37404` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:16.234079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5566f8271d714c0b8a5e6e2a9af37404)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:16.241116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:16.320173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5566f8271d714c0b8a5e6e2a9af37404'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:16.321140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5566f8271d714c0b8a5e6e2a9af37404'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:16.322079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5566f8271d714c0b8a5e6e2a9af37404'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:16.354947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5566f8271d714c0b8a5e6e2a9af37404'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:16.365387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5566f8271d714c0b8a5e6e2a9af37404'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:16.396434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 828/1650] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:16 2022] DELETE /identity/v3/users/5566f8271d714c0b8a5e6e2a9af37404 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:16.402343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:16.403414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:16.404030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:16.425703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:16.433727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:16.435498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:16.614026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 823/1651] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:16.678222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:16.682521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:16.720180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:16.829196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816d98e-4d4a-49bf-8c33-6388cff3809f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:16.834034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608718-16c9-45a3-9dc5-c32ab4558121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:16.834944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608718-16c9-45a3-9dc5-c32ab4558121 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:16.835439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608718-16c9-45a3-9dc5-c32ab4558121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:16.836452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608718-16c9-45a3-9dc5-c32ab4558121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:16.859312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608718-16c9-45a3-9dc5-c32ab4558121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:16.861257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608718-16c9-45a3-9dc5-c32ab4558121 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:16.897668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 829/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:17.877733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:17.880358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:17.906123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281d2e-c9de-4a82-abe5-b479af302d76 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:17.927047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:17.928075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:17.928383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:17.928623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] PATH_INFO: `/v3/projects/57d10dfcef7444a1b234b9ed064d75bf` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:17.940209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d10dfcef7444a1b234b9ed064d75bf)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:17.946668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:18.125948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d10dfcef7444a1b234b9ed064d75bf', 'request_id': 'req-dd632c9d-a490-4cf1-b36f-bd6adee28d13'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:18.139987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d10dfcef7444a1b234b9ed064d75bf', 'request_id': 'req-dd632c9d-a490-4cf1-b36f-bd6adee28d13'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:18.158165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d10dfcef7444a1b234b9ed064d75bf', 'request_id': 'req-dd632c9d-a490-4cf1-b36f-bd6adee28d13'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:18.193558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] The token cache is being invalidate because project 57d10dfcef7444a1b234b9ed064d75bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:18.193925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:18.195241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dd632c9d-a490-4cf1-b36f-bd6adee28d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:18.203031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 824/1653] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:17 2022] DELETE /identity/v3/projects/57d10dfcef7444a1b234b9ed064d75bf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:18.205072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:18.205558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:18.205638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:18.258299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:18.260288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:18.472451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:18.472676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 830/1654] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:18.473102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:18.473625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:18.527962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:18.529800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:18.555151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 825/1655] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:18.559106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:18.589696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa6ba-2ae6-4899-b12d-c6a7fc737d71 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:18.597265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:18.598332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:18.599373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:18.600175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:18.601666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:18.602262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:18.606612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1a52-f31d-4299-a36e-6b95ba193876 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:18.641441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 831/1656] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:18.642279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:18.664706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711933a-a49e-49cc-b811-0c4a3bbe8806 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:18.674507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:18.675434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:18.675875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:18.676285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:18.677129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:18.690461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:18.756634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 826/1657] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:18 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:18.760544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:18.760722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:18.762060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:18.762562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:18.824652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] MFA Rules not processed for user `bd434ec0ff3649998b7daa1bfd4dd4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:18.826489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:18.920611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af325e97-d8ac-44c6-8bd9-cd09e2238312 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:18.958097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:18.958804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:18.959093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:18.959379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:18.960170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:18.969784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:18.997857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 832/1658] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:19.007567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:19.009779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:19.025622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:19.058794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 827/1659] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:18 2022] POST /identity/v3/users => generated 303 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:19.059803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:19.093013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61fd50-1b91-4329-8176-67dd180dba9c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:19.102762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:19.103728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:19.104400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:19.104807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:19.105956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:19.119754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:19.159506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:19.163997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 828/1660] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:19.166935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:19.230375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90237385-6e2a-4ac6-9a73-0008ca82f3ee admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:19.262274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:19.263329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:19.264007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:19.265611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:19.267875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:19.271429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:19.313013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733acaf5-b083-408f-9051-1433b8695df7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:19.327936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 829/1661] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:19.331080 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aedbc1-2dac-4aed-9702-f74354eb13c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:19.332371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:19.332863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aedbc1-2dac-4aed-9702-f74354eb13c7 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:19.333251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aedbc1-2dac-4aed-9702-f74354eb13c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:19.334158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aedbc1-2dac-4aed-9702-f74354eb13c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:19.364899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fb9a0-119f-4796-8f56-864872bed575 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:19.375413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:19.378803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:19.379250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:19.380969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] PATH_INFO: `/v3/projects/8a524eed69ed43ffa36fc6ea86da4573/users/f9279cb4730c40eb8066b7c901cf2984/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:19.392328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aedbc1-2dac-4aed-9702-f74354eb13c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:19.403005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aedbc1-2dac-4aed-9702-f74354eb13c7 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:19.443676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a524eed69ed43ffa36fc6ea86da4573, user_id=f9279cb4730c40eb8066b7c901cf2984, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:19.447442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:19.455240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 833/1662] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:19.484047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 830/1663] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:19 2022] PUT /identity/v3/projects/8a524eed69ed43ffa36fc6ea86da4573/users/f9279cb4730c40eb8066b7c901cf2984/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:19.491316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:19.492893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:19.493232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:19.528344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:19.529946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:19.648581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 834/1664] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:19.659753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:19.662201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:19.824536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887ab5-0d38-4601-b3b6-a0d903d09d26 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:19.835742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc608-aa08-4833-a820-5ecc8dfcb064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:19.837893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc608-aa08-4833-a820-5ecc8dfcb064 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:19.838525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc608-aa08-4833-a820-5ecc8dfcb064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:19.840905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc608-aa08-4833-a820-5ecc8dfcb064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:19.872097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbc608-aa08-4833-a820-5ecc8dfcb064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:19.876126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbc608-aa08-4833-a820-5ecc8dfcb064 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:19.911629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 831/1665] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:20.199246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:20.200846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:20.219983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984862d5-23ad-4856-8c12-7e95037116dd None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:20.235735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:20.236693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:20.237367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:20.237840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] PATH_INFO: `/v3/projects/22b265e17aaf4af7b3266238b2f60e34` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:20.242860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b265e17aaf4af7b3266238b2f60e34)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:20.249306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:20.352008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b265e17aaf4af7b3266238b2f60e34', 'request_id': 'req-2a843c65-3dd0-4bb3-9b58-236602cfee93'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:20.374155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b265e17aaf4af7b3266238b2f60e34', 'request_id': 'req-2a843c65-3dd0-4bb3-9b58-236602cfee93'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:20.383298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b265e17aaf4af7b3266238b2f60e34', 'request_id': 'req-2a843c65-3dd0-4bb3-9b58-236602cfee93'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:20.400339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] The token cache is being invalidate because project 22b265e17aaf4af7b3266238b2f60e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:20.400924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:20.402594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a843c65-3dd0-4bb3-9b58-236602cfee93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:20.406316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 835/1666] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:20 2022] DELETE /identity/v3/projects/22b265e17aaf4af7b3266238b2f60e34 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:20.411888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:20.413418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:20.414189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:20.471156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:20.473604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:20.651680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 832/1667] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:20.656701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:20.657231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:20.658018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:20.723271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:20.724562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:20.745367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 836/1668] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:20.749579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:20.764833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535ddfa-a1bd-4624-8849-46b1a2593a67 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:20.784126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:20.784834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:20.785130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:20.785407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:20.786156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:20.786469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:20.792119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:20.843458 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 833/1669] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:20.843546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:20.853436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e2923-1527-45eb-a9be-790bf6b01c09 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:20.870373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:20.871076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:20.871368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:20.871692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:20.875187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:20.879929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:20.950162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 837/1670] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:20 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:20.954601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:20.977515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f411c-6f2a-49d7-8368-225a990e36a7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:21.074952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:21.157924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:21.159620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:21.160100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:21.161741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:21.163846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:21.182489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:21.232661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:21.241959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 834/1671] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:20 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:21.251165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42ec4f-9228-4747-863c-7636b78afafe admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:21.286047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:21.288447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:21.289799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:21.292883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:21.295258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:21.301659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:21.330103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:21.406550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:21.406717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 838/1672] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:21.427337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a8a5-95e9-45fe-8573-5c49927452ea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:21.440688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2021d-b5f4-4b5a-b30f-5fcb52ec012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:21.441386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2021d-b5f4-4b5a-b30f-5fcb52ec012c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:21.441678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2021d-b5f4-4b5a-b30f-5fcb52ec012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:21.441961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2021d-b5f4-4b5a-b30f-5fcb52ec012c admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:21.442710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2021d-b5f4-4b5a-b30f-5fcb52ec012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:21.445496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2021d-b5f4-4b5a-b30f-5fcb52ec012c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:21.482058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:21.489673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 835/1673] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:21.496057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187056-f21f-4479-96c7-a570e16f5bba admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:21.504209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187376d0-baf3-4b43-9675-1ab8968e220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:21.505456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187376d0-baf3-4b43-9675-1ab8968e220d admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:21.506103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187376d0-baf3-4b43-9675-1ab8968e220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:21.506568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187376d0-baf3-4b43-9675-1ab8968e220d admin admin] PATH_INFO: `/v3/projects/4af9ac71a05d40a783b341095469f22b/users/32ae9324769a4472a290f13fae47e1b3/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:21.529546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187376d0-baf3-4b43-9675-1ab8968e220d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af9ac71a05d40a783b341095469f22b, user_id=32ae9324769a4472a290f13fae47e1b3, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:21.533573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187376d0-baf3-4b43-9675-1ab8968e220d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:21.564617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:21.564911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:21.565192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:21.574599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 839/1674] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:21 2022] PUT /identity/v3/projects/4af9ac71a05d40a783b341095469f22b/users/32ae9324769a4472a290f13fae47e1b3/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:21.608920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] MFA Rules not processed for user `32ae9324769a4472a290f13fae47e1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:21.610959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:21.647879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:21.648325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:21.648614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:21.728780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] MFA Rules not processed for user `f9279cb4730c40eb8066b7c901cf2984`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:21.731292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:21.776523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 836/1675] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:21.777651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:21.937624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 840/1676] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:21.939889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:21.941468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:21.996653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a56316-2549-46a5-9d49-f996ddf04316 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.012140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.013111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.013549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.013981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.014829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.016969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.108022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 837/1677] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:21 2022] POST /identity/v3/projects => generated 373 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:22.115203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.136787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9942b-d617-4ec8-8b89-2ff445ee4098 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.204623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:22.333434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd8e99-1de7-4201-8e12-3985d722cd1a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.356514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.365646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.366005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.366287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.367046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.368428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.369135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.370090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.370669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.371360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.374002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.382686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.434309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:22.449954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 841/1678] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:21 2022] POST /identity/v3/projects => generated 403 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:22.451145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.464014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 838/1679] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:22 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:22.467863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.491097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb62cc-30c9-44f5-8919-de366c24dc7d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.639227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7fe52-d0e5-4192-be0b-e7bb09748c9b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.650483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.651189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.651512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.651782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.652492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.654465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.669999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.670775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.671020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.671300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.672096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.673769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.708485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 839/1680] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:22.716415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.719969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 842/1681] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:22 2022] POST /identity/v3/users => generated 308 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:22.721399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.744423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfab1e4-0770-4e73-8b3d-d2abaa10754b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.746140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7c2c-e122-457c-aec7-83015221c3c8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.763685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.764344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.764476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.764668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.764947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.765752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.766290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.766815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.767300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] PATH_INFO: `/v3/projects/52b18bffef7e47ff937597509caee14e/users/de4200dd9af94126afe7d54365558b22/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.767643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.804489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 843/1682] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:22.808302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.809198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b18bffef7e47ff937597509caee14e, user_id=de4200dd9af94126afe7d54365558b22, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.818151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.833013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b0b8a-d4aa-42e1-b622-ed6c738023bc admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:22.839691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:22.841438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:22.841919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:22.842339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] PATH_INFO: `/v3/projects/01c25dc6226941f6b671e4dd458145cb/users/d5ec710fdfeb4f759befc65ba50e65a1/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:22.855496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 840/1683] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:22 2022] PUT /identity/v3/projects/52b18bffef7e47ff937597509caee14e/users/de4200dd9af94126afe7d54365558b22/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:22.859332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:22.863666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c25dc6226941f6b671e4dd458145cb, user_id=d5ec710fdfeb4f759befc65ba50e65a1, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:22.871370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:22.906368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 844/1684] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:22 2022] PUT /identity/v3/projects/01c25dc6226941f6b671e4dd458145cb/users/d5ec710fdfeb4f759befc65ba50e65a1/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:22.916000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:23.056090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4c480-7858-4eda-9edb-eb5a2eba4e64 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:23.094956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762391-6d90-4abf-9587-b19092307964 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:23.111141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:23.111978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.112924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.113208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.114026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:23.115996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:23.150440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 845/1685] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:23.156089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:23.186563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:23.195293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5d7e1-6451-4383-888f-314e3d0dfaf4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:23.221122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62500-1209-4bc0-896f-6151a69bf75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:23.222546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62500-1209-4bc0-896f-6151a69bf75c admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.223017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62500-1209-4bc0-896f-6151a69bf75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.223493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62500-1209-4bc0-896f-6151a69bf75c admin admin] PATH_INFO: `/v3/projects/01c25dc6226941f6b671e4dd458145cb/users/d5ec710fdfeb4f759befc65ba50e65a1/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.227699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb62500-1209-4bc0-896f-6151a69bf75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c25dc6226941f6b671e4dd458145cb, user_id=d5ec710fdfeb4f759befc65ba50e65a1, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:23.231131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb62500-1209-4bc0-896f-6151a69bf75c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:23.273871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 846/1686] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:23 2022] PUT /identity/v3/projects/01c25dc6226941f6b671e4dd458145cb/users/d5ec710fdfeb4f759befc65ba50e65a1/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:23.298182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:23.301376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.307338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.307788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.308763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:23.311693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:23.329376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 841/1687] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:23.329691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860d34-859f-47c0-9354-ca6a50cd8060 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.329691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860d34-859f-47c0-9354-ca6a50cd8060 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.329691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860d34-859f-47c0-9354-ca6a50cd8060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.335330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:23.357537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572242a1-dc37-4288-92cb-8e8719d38d1c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:23.393684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3f860d34-859f-47c0-9354-ca6a50cd8060 None None] MFA Rules not processed for user `bd434ec0ff3649998b7daa1bfd4dd4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:23.405510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3f860d34-859f-47c0-9354-ca6a50cd8060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:23.498220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:23.499157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.499458 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.499744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] PATH_INFO: `/v3/projects/52b18bffef7e47ff937597509caee14e/users/de4200dd9af94126afe7d54365558b22/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.507480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:23.507964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b18bffef7e47ff937597509caee14e, user_id=de4200dd9af94126afe7d54365558b22, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:23.511596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:23.560670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 842/1688] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:23 2022] PUT /identity/v3/projects/52b18bffef7e47ff937597509caee14e/users/de4200dd9af94126afe7d54365558b22/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:23.561680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:23.571186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:23.586292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 847/1689] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:23.588453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.589751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.591143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.676228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] MFA Rules not processed for user `de4200dd9af94126afe7d54365558b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:23.679378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:23.741996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f0b2a-1b5f-4a38-837b-c1af67aa1c25 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:23.753135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:23.753658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.754152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.754233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] PATH_INFO: `/v3/users/27277c0a030844fbaa389f314fc9e3b3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.757737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27277c0a030844fbaa389f314fc9e3b3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:23.761752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:23.846540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 848/1690] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:23.862819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:23.866260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:23.877594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27277c0a030844fbaa389f314fc9e3b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:23.878402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27277c0a030844fbaa389f314fc9e3b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:23.879487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27277c0a030844fbaa389f314fc9e3b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:23.894752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27277c0a030844fbaa389f314fc9e3b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:23.898956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:23.907198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-30099155-399a-4780-87cd-5d63b573680b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27277c0a030844fbaa389f314fc9e3b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:23.942359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 843/1691] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:23 2022] DELETE /identity/v3/users/27277c0a030844fbaa389f314fc9e3b3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:23.947229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:23.947695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:23.947874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:23.981096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:23.997562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:24.005654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f8d6-d41c-4385-ac04-ffc4efc3894b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:24.146111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:24.146822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:24.147066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:24.147341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:24.151474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 844/1692] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:24.152534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:24.176839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:24.178671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:24.264898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:24.307514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:24.308966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:24.338449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e891-6d90-43ba-9642-ff6fe15b2ba6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:24.351302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5e28d-1371-4870-9974-e14964fb9a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:24.352172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5e28d-1371-4870-9974-e14964fb9a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:24.353089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5e28d-1371-4870-9974-e14964fb9a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:24.353442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5e28d-1371-4870-9974-e14964fb9a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:24.371282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5e28d-1371-4870-9974-e14964fb9a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:24.373643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 849/1693] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:24.379330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5e28d-1371-4870-9974-e14964fb9a5e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:24.412756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 845/1694] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:25.377724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:25.379944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:25.431104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305c0cd-d026-43b0-a5a7-b6e1369d0097 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:25.452977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:25.456713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:25.459338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:25.459659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] PATH_INFO: `/v3/users/32ae9324769a4472a290f13fae47e1b3` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:25.465776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ae9324769a4472a290f13fae47e1b3)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:25.473919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:25.564839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5afe9-e237-444d-abaa-9349f3529158 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:25.567686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5afe9-e237-444d-abaa-9349f3529158 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:25.568209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5afe9-e237-444d-abaa-9349f3529158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:25.574707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ae9324769a4472a290f13fae47e1b3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:25.575814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ae9324769a4472a290f13fae47e1b3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:25.576580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ae9324769a4472a290f13fae47e1b3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:25.613514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ae9324769a4472a290f13fae47e1b3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:25.628361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f27c5000-760f-469d-9c2b-6e5289c08c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ae9324769a4472a290f13fae47e1b3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:25.654150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 850/1695] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:25 2022] DELETE /identity/v3/users/32ae9324769a4472a290f13fae47e1b3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:25.657118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f08a54-b722-446e-bff2-2133e46e0375 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:25.657118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f08a54-b722-446e-bff2-2133e46e0375 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:25.665246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f08a54-b722-446e-bff2-2133e46e0375 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:25.666574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-36f5afe9-e237-444d-abaa-9349f3529158 None None] MFA Rules not processed for user `a2fd9d4ef85649c6ba75876e99df4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:25.669506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 851/1696] 10.222.0.57 () {54 vars in 912 bytes} [Mon Jul 25 08:43:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:25.670174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-36f5afe9-e237-444d-abaa-9349f3529158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:25.670839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4da5-2779-4517-9717-0376e5e1df0e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:25.676224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4da5-2779-4517-9717-0376e5e1df0e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:25.676663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4da5-2779-4517-9717-0376e5e1df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:25.724484 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-958f4da5-2779-4517-9717-0376e5e1df0e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:25.726787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-958f4da5-2779-4517-9717-0376e5e1df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:25.835166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 846/1697] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:25.836717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:25.837041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:25.839449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:25.890286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 852/1698] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:25.892802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:25.893113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:25.893399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:25.953713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:25.956368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:25.958521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:25.978553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] MFA Rules not processed for user `a2fd9d4ef85649c6ba75876e99df4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:25.982253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:26.002336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 853/1699] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:26.003217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:26.008095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:26.065276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 847/1700] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:26.066314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:26.068233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:26.126415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:26.148162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b8bb0-3320-4e32-96ad-bf7ce266eda0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:26.152335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:26.153426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:26.153908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:26.154557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:26.167680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:26.169611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:26.185044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 854/1701] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:26.186581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:26.197840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baa7a2-0f3b-47e8-89ef-098ce899511d service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:26.203661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993429b-0ece-417a-83eb-613520ac8661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:26.204725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993429b-0ece-417a-83eb-613520ac8661 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:26.205082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993429b-0ece-417a-83eb-613520ac8661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:26.205430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993429b-0ece-417a-83eb-613520ac8661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:26.215611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993429b-0ece-417a-83eb-613520ac8661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:26.218602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993429b-0ece-417a-83eb-613520ac8661 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:26.232469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1caf-c324-4abe-ab40-48caf17919f7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:26.234668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 855/1702] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:26.244683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c06c5-09a7-4eae-94be-4770aa2599c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:26.246020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c06c5-09a7-4eae-94be-4770aa2599c6 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:26.246702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c06c5-09a7-4eae-94be-4770aa2599c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:26.246702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c06c5-09a7-4eae-94be-4770aa2599c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:26.264057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c06c5-09a7-4eae-94be-4770aa2599c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:26.265525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c06c5-09a7-4eae-94be-4770aa2599c6 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:26.290694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 848/1703] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:27.452382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c972d3-ad04-4045-ac7e-aa68d99acafe None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:27.452382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c972d3-ad04-4045-ac7e-aa68d99acafe None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:27.452984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c972d3-ad04-4045-ac7e-aa68d99acafe None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:27.454646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 856/1704] 10.222.0.57 () {54 vars in 912 bytes} [Mon Jul 25 08:43:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:27.467672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:27.468650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:27.469191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:27.519792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:27.524873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:27.543550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 849/1705] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:43:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:27.586258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c972d3-ad04-4045-ac7e-aa68d99acafe None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:27.588602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-44c972d3-ad04-4045-ac7e-aa68d99acafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:27.610130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:27.611605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:27.624664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c972d3-ad04-4045-ac7e-aa68d99acafe None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:27.636317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06770-d72b-4543-8644-ec2a5cf7e8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:27.637254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06770-d72b-4543-8644-ec2a5cf7e8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:27.640959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06770-d72b-4543-8644-ec2a5cf7e8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:27.641513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06770-d72b-4543-8644-ec2a5cf7e8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:27.655646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a91a5-53f2-4f63-9287-dceaba47cd4a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:27.666306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b06770-d72b-4543-8644-ec2a5cf7e8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:27.668123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b06770-d72b-4543-8644-ec2a5cf7e8f2 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:27.676434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:27.677326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:27.677744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:27.677907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] PATH_INFO: `/v3/projects/826953cb538c4085bac1aa3f01211ee1` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:27.680201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826953cb538c4085bac1aa3f01211ee1)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:27.682801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:27.683690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 857/1706] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:27.793597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826953cb538c4085bac1aa3f01211ee1', 'request_id': 'req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:27.814408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826953cb538c4085bac1aa3f01211ee1', 'request_id': 'req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:27.821237 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826953cb538c4085bac1aa3f01211ee1', 'request_id': 'req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:27.857314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] The token cache is being invalidate because project 826953cb538c4085bac1aa3f01211ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:27.859541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:27.860695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ea99b42c-c3e2-44d5-a2d0-08be77c69f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:27.864306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 850/1707] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:27 2022] DELETE /identity/v3/projects/826953cb538c4085bac1aa3f01211ee1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:27.870465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4321-abb4-47ed-a8d1-b2ce672a6499 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:27.870893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4321-abb4-47ed-a8d1-b2ce672a6499 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:27.871282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4321-abb4-47ed-a8d1-b2ce672a6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:27.909609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-123b4321-abb4-47ed-a8d1-b2ce672a6499 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:27.911040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-123b4321-abb4-47ed-a8d1-b2ce672a6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:28.111919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 858/1708] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:28.122014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.122387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.122674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.178662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:28.179929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:28.202036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd5d6f-c8f7-4488-8cb4-149d2b94540c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.202484 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd5d6f-c8f7-4488-8cb4-149d2b94540c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.203017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd5d6f-c8f7-4488-8cb4-149d2b94540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.208379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 851/1709] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:28.213868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.231498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c06cae-b9b4-475c-ab70-b612ce85040a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.236966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.237870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.238302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.238731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.239771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:28.240229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.242033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.250749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:28.279262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 852/1710] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:28.280752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.294440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772142b-a0f1-4c4b-a687-580b50fd0f43 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.299960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.300985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.301416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.301837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.302751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.305593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.311442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-80fd5d6f-c8f7-4488-8cb4-149d2b94540c None None] MFA Rules not processed for user `d5ec710fdfeb4f759befc65ba50e65a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:28.317073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-80fd5d6f-c8f7-4488-8cb4-149d2b94540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:28.354316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 853/1711] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:28 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:28.355656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.498143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a838c5-9f15-456d-bc77-05ab0c7fdd78 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.516490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 859/1712] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:28.516490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01a8b-2c02-4897-a3e0-8ffec6cfd192 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.516490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01a8b-2c02-4897-a3e0-8ffec6cfd192 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.516490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01a8b-2c02-4897-a3e0-8ffec6cfd192 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.516490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 860/1713] 10.222.0.57 () {54 vars in 961 bytes} [Mon Jul 25 08:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:28.523636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.524246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.525149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.525370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.526227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.526654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.527070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.528550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.530669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.567016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:28.570094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:28.580329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 854/1714] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:28 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:28.584815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.597347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61278937-cfd7-40cf-9753-4a461f7bec59 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.603361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.604482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.605610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.606095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.607055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.610031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.651773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 855/1715] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:28.652819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.665176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623eb5-458e-4b7c-b969-043072efb69c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.671215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.672059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.672467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.673130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.674001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.677187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:28.680715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.698701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 856/1716] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:28.700170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.714440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b069c63-4aea-48f9-a91d-0d7e1c82d095 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.723009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af804c-4a16-4768-b6ba-197592184e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.724950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af804c-4a16-4768-b6ba-197592184e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.725791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af804c-4a16-4768-b6ba-197592184e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.726276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af804c-4a16-4768-b6ba-197592184e6a admin admin] PATH_INFO: `/v3/projects/04169d208273430fb2ffc6a6f8cb4684/users/0af05b7657864b02a280170e71781b3a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.752632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af804c-4a16-4768-b6ba-197592184e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04169d208273430fb2ffc6a6f8cb4684, user_id=0af05b7657864b02a280170e71781b3a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.757020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af804c-4a16-4768-b6ba-197592184e6a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.779229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 861/1717] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Jul 25 08:43:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:28.793438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:28.797222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 857/1718] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:28 2022] PUT /identity/v3/projects/04169d208273430fb2ffc6a6f8cb4684/users/0af05b7657864b02a280170e71781b3a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:28.814842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.815720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.816038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.818669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ecb3-1105-4216-b660-0c7da4d4cbb7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:28.868650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] MFA Rules not processed for user `0af05b7657864b02a280170e71781b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:28.870630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:28.954368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:28.955047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:28.955339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:28.955652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:28.959658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:28.975681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:28.978690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:28.994862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 862/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:29.047860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 858/1720] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:29.052464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:29.175483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce345-2945-474e-9c81-bb7c8aabab26 service placement] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:29.194843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa6462-3434-4f8e-a679-73657168e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:29.195904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa6462-3434-4f8e-a679-73657168e3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.197528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa6462-3434-4f8e-a679-73657168e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.198048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa6462-3434-4f8e-a679-73657168e3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.199015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa6462-3434-4f8e-a679-73657168e3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:29.203147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa6462-3434-4f8e-a679-73657168e3d3 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:29.293368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 863/1721] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:29 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:29.297042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:29.318834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca3eba-cbb3-4d69-a652-41763c4dba87 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:29.364305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:29.397269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdc53e-1fbf-4763-b3f3-cbfe31a25667 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.400076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdc53e-1fbf-4763-b3f3-cbfe31a25667 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.400371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdc53e-1fbf-4763-b3f3-cbfe31a25667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.523578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1bbdc53e-1fbf-4763-b3f3-cbfe31a25667 None None] MFA Rules not processed for user `fb1e3c767d0e4d8c810376176384d99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:29.527118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1bbdc53e-1fbf-4763-b3f3-cbfe31a25667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:29.649415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:29.650111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.650398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.650676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.652081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:29.662333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:29.691371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:29.728090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 859/1722] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:29 2022] POST /identity/v3/users => generated 289 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:29.733440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:29.776135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41feb0-32fb-4401-b81c-220f591c496f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:29.792066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:29.792772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.795358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.795765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.796630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:29.797235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 864/1723] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:29.807023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:29.811140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.811616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.811788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.850590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] MFA Rules not processed for user `fb1e3c767d0e4d8c810376176384d99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:29.855962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:29.873613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 865/1724] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:29.874731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:29.884671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 860/1725] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:29.889491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639029-7572-47db-a74a-faf768b0a80f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:29.898901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:29.900233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.900530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.900812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] PATH_INFO: `/v3/projects/7895e70e86804873b2953edb6261ae49/users/e352524204df4e5490f22600e5668f0d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.960911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7895e70e86804873b2953edb6261ae49, user_id=e352524204df4e5490f22600e5668f0d, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:29.963954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:29.994750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 866/1726] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:29 2022] PUT /identity/v3/projects/7895e70e86804873b2953edb6261ae49/users/e352524204df4e5490f22600e5668f0d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:29.999069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:30.019246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c076f-daf5-4e6e-b07d-7761dcde6bc2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:30.096299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:30.098952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:30.215124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:30.216205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:30.216721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:30.217212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:30.218748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:30.229979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:30.271424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 861/1727] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:30.273536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:30.281914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:30.367292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63f21-78bb-4a2a-9631-b5da0959f74d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:30.377552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:30.379464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:30.380355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:30.381959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] PATH_INFO: `/v3/projects/4af9ac71a05d40a783b341095469f22b` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:30.386329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af9ac71a05d40a783b341095469f22b)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:30.391296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:30.509533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760104c-e906-4c07-9e51-ae57723249af admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:30.523149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfedff6-0e64-45c9-bf6d-3bc027066f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:30.524862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfedff6-0e64-45c9-bf6d-3bc027066f9e service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:30.525158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfedff6-0e64-45c9-bf6d-3bc027066f9e service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:30.525449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfedff6-0e64-45c9-bf6d-3bc027066f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:30.594876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:30.640870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af9ac71a05d40a783b341095469f22b', 'request_id': 'req-2fb8e389-4954-404d-9fcb-51d268c77b45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:30.668675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af9ac71a05d40a783b341095469f22b', 'request_id': 'req-2fb8e389-4954-404d-9fcb-51d268c77b45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:30.703972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af9ac71a05d40a783b341095469f22b', 'request_id': 'req-2fb8e389-4954-404d-9fcb-51d268c77b45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:30.742910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] The token cache is being invalidate because project 4af9ac71a05d40a783b341095469f22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:30.743204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:30.744835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:30.747726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 867/1728] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:30 2022] DELETE /identity/v3/projects/4af9ac71a05d40a783b341095469f22b => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:30.748558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:30.752678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:30.783442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfedff6-0e64-45c9-bf6d-3bc027066f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:30.785770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfedff6-0e64-45c9-bf6d-3bc027066f9e service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:30.833367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 862/1729] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:30.838924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581b9a-2e0e-4c19-b509-812a130e38af None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:30.839222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581b9a-2e0e-4c19-b509-812a130e38af None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:30.844194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581b9a-2e0e-4c19-b509-812a130e38af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:30.918178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-35581b9a-2e0e-4c19-b509-812a130e38af None None] MFA Rules not processed for user `a2fd9d4ef85649c6ba75876e99df4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:30.919468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-35581b9a-2e0e-4c19-b509-812a130e38af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:30.931601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:31.032632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8e389-4954-404d-9fcb-51d268c77b45 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:31.053252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:31.061389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:31.063748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:31.068039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] PATH_INFO: `/v3/projects/7895e70e86804873b2953edb6261ae49/users/e352524204df4e5490f22600e5668f0d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:31.082863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7895e70e86804873b2953edb6261ae49, user_id=e352524204df4e5490f22600e5668f0d, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:31.109325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:31.181037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 868/1730] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:30 2022] PUT /identity/v3/projects/7895e70e86804873b2953edb6261ae49/users/e352524204df4e5490f22600e5668f0d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:31.191577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:31.197871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 863/1731] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:31.201197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d7ff-093d-4df9-88e3-9fda67a87ad0 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:31.204001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d7ff-093d-4df9-88e3-9fda67a87ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:31.204505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d7ff-093d-4df9-88e3-9fda67a87ad0 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:31.204637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:31.213525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 864/1732] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:43:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:31.215251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ac9a-f612-4e23-ac66-3e59768cc3d2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:31.223095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ac9a-f612-4e23-ac66-3e59768cc3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:31.223687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ac9a-f612-4e23-ac66-3e59768cc3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:31.327937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-88e7ac9a-f612-4e23-ac66-3e59768cc3d2 None None] MFA Rules not processed for user `e352524204df4e5490f22600e5668f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:31.330043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-88e7ac9a-f612-4e23-ac66-3e59768cc3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:31.564729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fa108-ec54-4a0e-96a8-aff3b240ae01 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:31.572508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 865/1733] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:31.572508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:31.572508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:31.572508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:31.593369 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:31.594303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:31.598082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:31.598453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] PATH_INFO: `/v3/users/de4200dd9af94126afe7d54365558b22` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:31.601928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4200dd9af94126afe7d54365558b22)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:31.605519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:31.676289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:31.682198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:31.729984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4200dd9af94126afe7d54365558b22'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:31.733712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4200dd9af94126afe7d54365558b22'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:31.734407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4200dd9af94126afe7d54365558b22'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:31.765758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4200dd9af94126afe7d54365558b22'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:31.786928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4200dd9af94126afe7d54365558b22'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:31.824798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 869/1734] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:31 2022] DELETE /identity/v3/users/de4200dd9af94126afe7d54365558b22 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:31.825995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:31.827764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:31.939787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:31.988873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 866/1735] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:32.009486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:32.010985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:32.036115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e9fac-643b-4c09-be93-585c9609390b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:32.037249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb89a9-2854-4f95-a368-36a62b50167e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:32.044796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:32.045491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:32.045779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:32.046058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:32.051648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:32.067077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:32.182478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:32.183279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:32.183637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:32.184040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:32.215137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:32.223299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:32.250710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 867/1736] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:32.366066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:32.369680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:32.397572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 870/1737] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:32.630078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:32.644648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472ccd-5860-4d73-ba08-d829761d232c service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:32.652137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:32.653112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:32.653679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:32.654288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:32.658084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:32.804109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:32.807829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed174984-cec9-43f8-bd4b-b9d15d668226 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:32.832910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 868/1738] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:33.104522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:33.106193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:33.261633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93894e18-ca22-45e4-9f02-5199115c30bc service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:33.282912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:33.283872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:33.284157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:33.284543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] PATH_INFO: `/v3/users/c10e6a7693974594bf7278498b4d18c2` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:33.291315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10e6a7693974594bf7278498b4d18c2)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:33.293356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:33.430553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10e6a7693974594bf7278498b4d18c2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:33.431531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10e6a7693974594bf7278498b4d18c2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:33.432316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10e6a7693974594bf7278498b4d18c2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:33.495110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10e6a7693974594bf7278498b4d18c2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:33.542211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-12ca6eb7-143e-4ae1-8c0b-d65a227707e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10e6a7693974594bf7278498b4d18c2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:33.587187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 871/1739] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:33 2022] DELETE /identity/v3/users/c10e6a7693974594bf7278498b4d18c2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:33.591502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:33.592066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:33.592066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:33.702756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:33.704867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:33.728688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:33.729227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:33.729591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:33.816904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:33.893419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:33.901747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.018909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 869/1740] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:34.035177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:34.037535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.084130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:34.204886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f93b5-a13a-4465-9cd9-84c358f38dc4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:34.213314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 872/1741] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:43:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 25 08:43:34.214333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:34.219419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab9ae-269e-4c94-aa35-a67c06bd97d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:34.220532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab9ae-269e-4c94-aa35-a67c06bd97d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.221213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab9ae-269e-4c94-aa35-a67c06bd97d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.221679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.222135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab9ae-269e-4c94-aa35-a67c06bd97d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.255783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fab9ae-269e-4c94-aa35-a67c06bd97d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:34.260775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fab9ae-269e-4c94-aa35-a67c06bd97d6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:34.289191 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6ff8-657e-412a-967a-674ee9455785 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:34.297412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 870/1742] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:34.298996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.299279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.299585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.309426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:34.310331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.310616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.310895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] PATH_INFO: `/v3/users/f9279cb4730c40eb8066b7c901cf2984` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.316443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9279cb4730c40eb8066b7c901cf2984)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:34.333421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:34.392390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] MFA Rules not processed for user `d9d24a461bf543148b3c0e45a9d2006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:34.393620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.497677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9279cb4730c40eb8066b7c901cf2984'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:34.501739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9279cb4730c40eb8066b7c901cf2984'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:34.506506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9279cb4730c40eb8066b7c901cf2984'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:34.569983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9279cb4730c40eb8066b7c901cf2984'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:34.598663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9279cb4730c40eb8066b7c901cf2984'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:34.638900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 873/1743] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:34 2022] DELETE /identity/v3/users/f9279cb4730c40eb8066b7c901cf2984 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:34.640264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:34.646472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.671740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 871/1744] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:34.686508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:34.688559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.820192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:34.887250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403729a1-e67a-4081-8c20-cadfe0c26f2f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:34.899853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccacda-e77c-46db-8cef-d44e921f7729 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:34.918491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:34.921342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.922499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.922820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.931455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:35.015334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:35.085127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ff31-989f-48a8-99c1-3b525eb60aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:35.088824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ff31-989f-48a8-99c1-3b525eb60aea service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:35.090108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ff31-989f-48a8-99c1-3b525eb60aea service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:35.090406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ff31-989f-48a8-99c1-3b525eb60aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:35.113579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:35.116581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:35.152006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 874/1745] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:43:35.251810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ff31-989f-48a8-99c1-3b525eb60aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:35.253828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ff31-989f-48a8-99c1-3b525eb60aea service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:35.303853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 872/1746] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:35.426803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:35.445682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:35.757894 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8954-e007-42ef-b39b-ce5c1e6d4b59 service swift] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:35.772372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:35.773287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:35.773565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:35.773845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] PATH_INFO: `/v3/projects/52b18bffef7e47ff937597509caee14e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:35.776357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b18bffef7e47ff937597509caee14e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:35.778508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:35.907546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b18bffef7e47ff937597509caee14e', 'request_id': 'req-790d28a4-8b37-445f-ae0a-a69f959185f0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:35.928245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b18bffef7e47ff937597509caee14e', 'request_id': 'req-790d28a4-8b37-445f-ae0a-a69f959185f0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:35.939009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b18bffef7e47ff937597509caee14e', 'request_id': 'req-790d28a4-8b37-445f-ae0a-a69f959185f0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:35.981594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] The token cache is being invalidate because project 52b18bffef7e47ff937597509caee14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:35.983204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:35.987556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-790d28a4-8b37-445f-ae0a-a69f959185f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:35.998238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 875/1747] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:35 2022] DELETE /identity/v3/projects/52b18bffef7e47ff937597509caee14e => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:36.000555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:36.001319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:36.001319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:36.061977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:36.063239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:36.222017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 873/1748] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:36.230529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:36.231108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:36.232233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:36.289077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:36.291197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:36.318946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 876/1749] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:36.320611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:36.334841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b602781-6309-4e29-8635-dcb3362f445e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:36.404150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:36.405452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:36.407621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:36.410149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:36.411113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:36.413165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:36.416702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:36.429124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:36.431256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:36.462465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d6a0-f971-42f4-a318-353505de7e52 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:36.473416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 874/1750] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:36.474510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:36.493722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dbeea-1d88-4361-9fad-ea0f7d8057ad admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:36.500899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:36.510913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:36.511308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:36.511753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:36.512448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:36.512743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:36.513027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:36.513175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] PATH_INFO: `/v3/projects/8a524eed69ed43ffa36fc6ea86da4573` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:36.513744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:36.517236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:36.521662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a524eed69ed43ffa36fc6ea86da4573)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:36.523682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:36.575419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:36.639788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 875/1751] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:36 2022] POST /identity/v3/projects => generated 391 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:36.643613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:36.735067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a524eed69ed43ffa36fc6ea86da4573', 'request_id': 'req-8271c048-22d3-4390-820b-b991e4fd2374'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:36.768722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a524eed69ed43ffa36fc6ea86da4573', 'request_id': 'req-8271c048-22d3-4390-820b-b991e4fd2374'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:36.784493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a524eed69ed43ffa36fc6ea86da4573', 'request_id': 'req-8271c048-22d3-4390-820b-b991e4fd2374'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:36.846816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:36.854929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] The token cache is being invalidate because project 8a524eed69ed43ffa36fc6ea86da4573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:36.855314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:36.859992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:36.869089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 877/1752] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:36 2022] DELETE /identity/v3/projects/8a524eed69ed43ffa36fc6ea86da4573 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:36.873313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:36.877833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:36.884525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144db0-e316-4b38-b199-7cdfc3dee867 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:37.032890 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:37.034961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.036689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.037829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.038388 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:37.044939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:37.117551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 876/1753] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:36 2022] POST /identity/v3/users => generated 296 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:37.122315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:37.126297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:37.180110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108bc6b-092c-40f2-8188-e28918fa29a8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:37.191330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:37.195532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.195991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.196394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.197506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:37.199321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:37.225409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 877/1754] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:37.226939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:37.236146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c048-22d3-4390-820b-b991e4fd2374 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:37.253213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6136a-40df-4eca-9291-a1e6e66781b9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:37.253649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:37.254561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.254858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.255132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] PATH_INFO: `/v3/users/d5ec710fdfeb4f759befc65ba50e65a1` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.264018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:37.266135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.267742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.267742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.267979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ec710fdfeb4f759befc65ba50e65a1)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:37.269962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:37.270429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:37.275242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:37.316422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 878/1755] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:37.318867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:37.353151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c8ea-20f7-417b-be84-9422198c8acf admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:37.367808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dba4c-d44c-4029-8650-5df3b1fe4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:37.370592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dba4c-d44c-4029-8650-5df3b1fe4c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.372124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dba4c-d44c-4029-8650-5df3b1fe4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.373142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dba4c-d44c-4029-8650-5df3b1fe4c58 admin admin] PATH_INFO: `/v3/projects/1ff72f9c6ade4d16ac42822d5c3ceb1f/users/0377f09a8ba54dc29e3e4e5f1df0b503/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.418965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dba4c-d44c-4029-8650-5df3b1fe4c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff72f9c6ade4d16ac42822d5c3ceb1f, user_id=0377f09a8ba54dc29e3e4e5f1df0b503, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:37.424810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dba4c-d44c-4029-8650-5df3b1fe4c58 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:37.439614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ec710fdfeb4f759befc65ba50e65a1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:37.441392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ec710fdfeb4f759befc65ba50e65a1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:37.442893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ec710fdfeb4f759befc65ba50e65a1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:37.487437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ec710fdfeb4f759befc65ba50e65a1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:37.491166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 879/1756] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:37 2022] PUT /identity/v3/projects/1ff72f9c6ade4d16ac42822d5c3ceb1f/users/0377f09a8ba54dc29e3e4e5f1df0b503/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:37.502654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.503669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.504070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.522055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ec710fdfeb4f759befc65ba50e65a1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:37.573856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 878/1757] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:36 2022] DELETE /identity/v3/users/d5ec710fdfeb4f759befc65ba50e65a1 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:37.607535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] MFA Rules not processed for user `0377f09a8ba54dc29e3e4e5f1df0b503`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:37.610009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:37.813084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 880/1758] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:37.817471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:37.818946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:37.862216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:38.010566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edaac-0a86-485f-92cc-d3493e42631a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:38.040367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:38.040367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:38.040367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:38.040367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:38.043988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:38.046021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:38.173091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:38.183679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 879/1759] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:37 2022] POST /identity/v3/projects => generated 391 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:38.196474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46cbe-6bb8-4c60-9f16-955f0f0fc6bc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:38.341699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:38.486887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:38.487628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:38.487917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:38.488200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:38.492958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:38.501589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:38.598451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:38.600493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 881/1760] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:38 2022] POST /identity/v3/users => generated 302 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:38.622146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49c23-6080-4735-b40f-651c18e2eebb admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:38.640265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:38.644184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:38.646279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:38.647704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:38.648761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:38.657638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:38.703750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 880/1761] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:43:38.708853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:38.725783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54374e-e913-4537-86a3-bb7ab3290498 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:38.757228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:38.758161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:38.771681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:38.776945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] PATH_INFO: `/v3/projects/6456b71196cc46879466bdf26d977f87/users/e9647606ea1f40a6914d86fd0a496449/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:38.828842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6456b71196cc46879466bdf26d977f87, user_id=e9647606ea1f40a6914d86fd0a496449, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:38.833024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:38.871518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 882/1762] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:38 2022] PUT /identity/v3/projects/6456b71196cc46879466bdf26d977f87/users/e9647606ea1f40a6914d86fd0a496449/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:38.872733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:38.889442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802af9-7ec5-4745-9eaa-38b5cd232c41 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:39.091070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:39.093340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:39.159569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:39.161240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.161807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.162312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.163248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:39.167658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:39.204698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 881/1763] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:39.208653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:39.235887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78a23-e97f-47c7-9c54-48f1a063a3b9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:39.245253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52ec0-23cf-4406-8118-19043854aad0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:39.248130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:39.259058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.261191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.264410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] PATH_INFO: `/v3/projects/01c25dc6226941f6b671e4dd458145cb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.270137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c25dc6226941f6b671e4dd458145cb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:39.273235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:39.276543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508b217-9478-46a2-945a-185ba4197c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:39.280785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508b217-9478-46a2-945a-185ba4197c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.282573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508b217-9478-46a2-945a-185ba4197c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.283821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508b217-9478-46a2-945a-185ba4197c0a admin admin] PATH_INFO: `/v3/projects/6456b71196cc46879466bdf26d977f87/users/e9647606ea1f40a6914d86fd0a496449/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.289214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508b217-9478-46a2-945a-185ba4197c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6456b71196cc46879466bdf26d977f87, user_id=e9647606ea1f40a6914d86fd0a496449, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:39.303549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508b217-9478-46a2-945a-185ba4197c0a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:39.346276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 882/1764] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:39 2022] PUT /identity/v3/projects/6456b71196cc46879466bdf26d977f87/users/e9647606ea1f40a6914d86fd0a496449/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:39.384012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c87d4-38f8-4858-851f-ea63ed8de06e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.384319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c87d4-38f8-4858-851f-ea63ed8de06e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.393573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c87d4-38f8-4858-851f-ea63ed8de06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.465475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c25dc6226941f6b671e4dd458145cb', 'request_id': 'req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:39.483566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c25dc6226941f6b671e4dd458145cb', 'request_id': 'req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:39.492848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c25dc6226941f6b671e4dd458145cb', 'request_id': 'req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:39.518793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] The token cache is being invalidate because project 01c25dc6226941f6b671e4dd458145cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:39.519120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:39.522440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e04ae8e2-5b52-47d6-9a72-a48a9a140f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:39.526816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 883/1765] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:39 2022] DELETE /identity/v3/projects/01c25dc6226941f6b671e4dd458145cb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:39.531283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e917a-40db-438d-8624-84b202235e49 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.531834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e917a-40db-438d-8624-84b202235e49 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.532128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e917a-40db-438d-8624-84b202235e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.605367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-323c87d4-38f8-4858-851f-ea63ed8de06e None None] MFA Rules not processed for user `e9647606ea1f40a6914d86fd0a496449`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:39.609667 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-400e917a-40db-438d-8624-84b202235e49 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:39.610363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-323c87d4-38f8-4858-851f-ea63ed8de06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:39.611033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-400e917a-40db-438d-8624-84b202235e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:39.696591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:39.826298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 884/1766] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:39.826298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.826298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.826298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.846313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:39.847743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:39.985572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:40.026317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 883/1767] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 646 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:40.026317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.026317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.026317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.070791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 885/1768] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Jul 25 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:40.076455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:40.077107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.077708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.083502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.115330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 884/1769] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:40.123424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.123424 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.153587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626c8f6-e7b9-42ef-b32d-c7936524773c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.164126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.165213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.165213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.165491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.192824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.194302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.243101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 885/1770] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:40.245129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.271202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5fde0-3b95-4871-bba6-9b9f51e3e0c9 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.273920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55224b79-2ee8-4f65-9dec-392e66c23ca7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.278569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.279885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.280407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.280898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.281854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:40.282887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.285417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.285537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.286113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.286407 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.286727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.318300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 886/1771] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:40.319368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.335219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.338905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.346590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b8370-fe17-498a-976e-088dc0e5736a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.368659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.369514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.369907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.370293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.371108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.373306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.377606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 886/1772] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:40.403579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.406476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.457549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d438-dd41-4de8-adc5-41ea1666b9a3 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.489465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.493832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.496560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.498665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] PATH_INFO: `/v3/projects/84515aaea993411ab1b08b66152679d0` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.502345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 887/1773] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:40 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:40.504062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84515aaea993411ab1b08b66152679d0)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.506649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.511895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.633030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2f2d-03ba-401c-9194-982e67fb0833 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.637229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.645105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.645105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.645105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.645105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.645105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.684923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 888/1774] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:40 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:40.693430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.715580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84515aaea993411ab1b08b66152679d0', 'request_id': 'req-8c6db7ce-acd6-4eea-8052-99ac2902afd8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:40.743624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84515aaea993411ab1b08b66152679d0', 'request_id': 'req-8c6db7ce-acd6-4eea-8052-99ac2902afd8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:40.764306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84515aaea993411ab1b08b66152679d0', 'request_id': 'req-8c6db7ce-acd6-4eea-8052-99ac2902afd8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:40.794004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:40.810666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] The token cache is being invalidate because project 84515aaea993411ab1b08b66152679d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:40.811518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:40.814724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7b3df-a236-46d2-98d2-0ad6b676787c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.817756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:40.824250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 887/1775] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:40 2022] DELETE /identity/v3/projects/84515aaea993411ab1b08b66152679d0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:40.829827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.833140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.970176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6db7ce-acd6-4eea-8052-99ac2902afd8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.976730 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:40.977512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.978599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.978885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.979168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.980092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:40.981758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:40.994847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 888/1776] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:40.995798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.997926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.998735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.999433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.002122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.002488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.009253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:41.013527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee99f-b23d-4052-97df-46da2210ebd6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:41.025643 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:41.026533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.026828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.027097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] PATH_INFO: `/v3/users/dbf6b865017247d7934dcd493291773f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.031283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf6b865017247d7934dcd493291773f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:41.033511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:41.242319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:41.245813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:41.246450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf6b865017247d7934dcd493291773f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:41.247747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf6b865017247d7934dcd493291773f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:41.250365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf6b865017247d7934dcd493291773f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:41.307471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 889/1777] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:41.308929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:41.317147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf6b865017247d7934dcd493291773f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:41.340659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf6b865017247d7934dcd493291773f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:41.355964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fdf0d-31c8-4cbc-812d-cb4eadfb92bb service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:41.373729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8062fb-5e50-4344-9701-120b3e09838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:41.374809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8062fb-5e50-4344-9701-120b3e09838d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.377957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8062fb-5e50-4344-9701-120b3e09838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.379892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8062fb-5e50-4344-9701-120b3e09838d admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.380889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8062fb-5e50-4344-9701-120b3e09838d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:41.387638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8062fb-5e50-4344-9701-120b3e09838d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:41.390868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 889/1778] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:40 2022] DELETE /identity/v3/users/dbf6b865017247d7934dcd493291773f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:41.410517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 890/1779] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:41.414499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:41.416288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:41.620293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24881f87-9a96-4b9e-a134-4435d9d541ea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:41.648141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:41.649110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.649448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.649851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] PATH_INFO: `/v3/projects/1b05e47d30c34b709b72f9822f0a8de0/users/77ef61b06f014f7bac80cd1c2da6aa38/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.701406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:41.706645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b05e47d30c34b709b72f9822f0a8de0, user_id=77ef61b06f014f7bac80cd1c2da6aa38, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:41.710957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:41.765381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 890/1780] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:41 2022] PUT /identity/v3/projects/1b05e47d30c34b709b72f9822f0a8de0/users/77ef61b06f014f7bac80cd1c2da6aa38/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:41.768406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.768406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.768406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.890834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] MFA Rules not processed for user `77ef61b06f014f7bac80cd1c2da6aa38`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:41.894826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:42.178210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 891/1781] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:42.179792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:42.395088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010766-8cd1-48ed-bff2-e8c0d232f216 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:42.408632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:42.409246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:42.409415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:42.410055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:42.410437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:42.413866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:42.495561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 891/1782] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:42 2022] POST /identity/v3/projects => generated 387 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:42.496993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:42.539811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1bab7-df52-46f9-9609-36f4cbb855a6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:42.765220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:42.766208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:42.766601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:42.766981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:42.767825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:42.771340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:42.826599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 892/1783] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:42 2022] POST /identity/v3/users => generated 300 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:42.828017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:42.840382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748cd4e-086e-4656-8f6d-10419b5249ea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:42.849153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:42.851572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:42.852003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:42.854114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:42.854990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:42.859428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:42.913130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 892/1784] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:42.914800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:42.931856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6070-1a36-4c04-9293-64d22aa30667 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:42.944182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:42.947629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:42.948318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:42.950109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] PATH_INFO: `/v3/projects/fbd2f557cf1d4f668f7e9a8d37795d3a/users/67ad749852614818b0feaa28bb00c90e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:42.956571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:42.965201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:42.967090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:42.996228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569c6c2-6893-4c5d-86f0-6f24b95f03c9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:43.005499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd2f557cf1d4f668f7e9a8d37795d3a, user_id=67ad749852614818b0feaa28bb00c90e, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:43.014816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:43.017879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:43.018981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:43.020558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:43.021265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] PATH_INFO: `/v3/users/0af05b7657864b02a280170e71781b3a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:43.026461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af05b7657864b02a280170e71781b3a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:43.032658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:43.115353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 893/1785] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:42 2022] PUT /identity/v3/projects/fbd2f557cf1d4f668f7e9a8d37795d3a/users/67ad749852614818b0feaa28bb00c90e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:43.116583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:43.140480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af05b7657864b02a280170e71781b3a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.142671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af05b7657864b02a280170e71781b3a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.143779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af05b7657864b02a280170e71781b3a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.174850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af05b7657864b02a280170e71781b3a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.210421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-47562b9c-7415-4144-97f5-8dd811bbde28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af05b7657864b02a280170e71781b3a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.254218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 893/1786] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:42 2022] DELETE /identity/v3/users/0af05b7657864b02a280170e71781b3a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:43.261470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35225d-37d9-4539-859f-4152459c021b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:43.261828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35225d-37d9-4539-859f-4152459c021b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:43.262212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35225d-37d9-4539-859f-4152459c021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:43.335638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2a35225d-37d9-4539-859f-4152459c021b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:43.342556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2a35225d-37d9-4539-859f-4152459c021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:43.404494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212fda-b66a-4679-bb7e-7821a8427828 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:43.480557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:43.594779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 894/1787] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:43.634025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:43.634943 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:43.635331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:43.635736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:43.636587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:43.643834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35225d-37d9-4539-859f-4152459c021b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:43.646226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2a35225d-37d9-4539-859f-4152459c021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:43.657529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:43.678545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35225d-37d9-4539-859f-4152459c021b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:43.696388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 894/1788] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:43.699986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:43.700784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:43.702077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:43.703437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:43.704336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] PATH_INFO: `/v3/projects/67b3ea150a39470293cf8089007fe49d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:43.706808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:43.709047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b3ea150a39470293cf8089007fe49d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:43.712487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:43.870536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b3ea150a39470293cf8089007fe49d', 'request_id': 'req-b8a6f609-4302-4a83-976a-13c0d18893b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.870670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ebfd7-adcc-45e9-a82f-aec239b04142 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:43.886812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b3ea150a39470293cf8089007fe49d', 'request_id': 'req-b8a6f609-4302-4a83-976a-13c0d18893b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.901743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b3ea150a39470293cf8089007fe49d', 'request_id': 'req-b8a6f609-4302-4a83-976a-13c0d18893b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.932867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] The token cache is being invalidate because project 67b3ea150a39470293cf8089007fe49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:43.934842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.936726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:43.943492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 895/1789] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:43 2022] DELETE /identity/v3/projects/67b3ea150a39470293cf8089007fe49d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:43.946690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:43.950265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:44.003650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:44.015587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:44.017120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.020056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.020056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.045188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:44.277595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6f609-4302-4a83-976a-13c0d18893b3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:44.302854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6868a7-44c5-49b9-a286-b1fd7095b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:44.306813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6868a7-44c5-49b9-a286-b1fd7095b275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.306813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6868a7-44c5-49b9-a286-b1fd7095b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.306813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6868a7-44c5-49b9-a286-b1fd7095b275 admin admin] PATH_INFO: `/v3/projects/fbd2f557cf1d4f668f7e9a8d37795d3a/users/67ad749852614818b0feaa28bb00c90e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.320113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6868a7-44c5-49b9-a286-b1fd7095b275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd2f557cf1d4f668f7e9a8d37795d3a, user_id=67ad749852614818b0feaa28bb00c90e, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:44.333188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6868a7-44c5-49b9-a286-b1fd7095b275 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:44.354402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:44.362244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82217dda-0a98-4397-b806-4fccc987b042 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:44.411797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 895/1790] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:44.416303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.416615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.416881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.431723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 896/1791] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:43 2022] PUT /identity/v3/projects/fbd2f557cf1d4f668f7e9a8d37795d3a/users/67ad749852614818b0feaa28bb00c90e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:44.445782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f263e2-8552-4e00-9f6d-3f94a1e332f2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.446267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f263e2-8552-4e00-9f6d-3f94a1e332f2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.446622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f263e2-8552-4e00-9f6d-3f94a1e332f2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.469573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 897/1792] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:43:44 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:44.472272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec030f-9a61-48a5-b684-c895709e841b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.472272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec030f-9a61-48a5-b684-c895709e841b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.472272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec030f-9a61-48a5-b684-c895709e841b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.476594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:44.486829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:44.588937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7eec030f-9a61-48a5-b684-c895709e841b None None] MFA Rules not processed for user `67ad749852614818b0feaa28bb00c90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:44.591217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7eec030f-9a61-48a5-b684-c895709e841b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:44.720054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:44.793696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 898/1793] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:44.805594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 896/1794] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:44.812601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.814461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:44.816272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.816615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.818228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:44.949164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:44.954545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.000094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 899/1795] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:45.004514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.060094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df5d6-b879-4704-b037-4ede71fc6841 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.093475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.094821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.095692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.096107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.097295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:45.097529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.100926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81b2f-6d25-45b7-9308-f0ccb95c1bcd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.127750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 900/1796] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:43:45.132726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.135829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.136887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.187137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc606807-e33b-45f4-b090-dc88389d2615 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.209887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.211091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.212063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.212679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.249463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:45.251006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.256880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.272253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.315569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 897/1797] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:45.317342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.355900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a646c-8c95-47ae-a7c8-e614929075b8 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.374859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.375837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.376258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.376676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.377809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.380074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.510390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 898/1798] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:45 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:45.514215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.572151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:45.574758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 901/1799] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:45.575864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.606922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a31f6-2e06-43dc-8573-9cc4c556b261 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.702333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbefee-67be-49fc-a516-12307d21f2f0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.714271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.715358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.716792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.717086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] PATH_INFO: `/v3/users/77ef61b06f014f7bac80cd1c2da6aa38` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.719489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ef61b06f014f7bac80cd1c2da6aa38)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.723821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.773628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.774713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.775204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.775741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.780108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.787929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.834213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ef61b06f014f7bac80cd1c2da6aa38'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:45.835501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ef61b06f014f7bac80cd1c2da6aa38'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:45.836720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ef61b06f014f7bac80cd1c2da6aa38'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:45.858542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 902/1800] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:45 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:45.863912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ef61b06f014f7bac80cd1c2da6aa38'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:45.868192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.874877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.883740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-161af2d0-5a32-4c63-8e5c-ed44afea56d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ef61b06f014f7bac80cd1c2da6aa38'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:45.900875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa791aa-d188-4ee9-892a-8a49455a324c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.914896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 899/1801] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:45 2022] DELETE /identity/v3/users/77ef61b06f014f7bac80cd1c2da6aa38 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:45.921212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.921760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.922545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.923042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.925159 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.925652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.926797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.927798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.933295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.969408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 903/1802] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:45.976123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.985469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:45.988346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.999577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75747078-e903-45a9-a02f-c47d0cf00e37 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:46.083970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:46.163892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 900/1803] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:46.165722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:46.167204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:46.174665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:46.204119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:46.209615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:46.210123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:46.211455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:46.213154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:46.251188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 904/1804] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:46.252166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:46.271054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:46.274200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907292e-960e-4efd-98e3-05ed55399856 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:46.280621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:46.282438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:46.283335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:46.284301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] PATH_INFO: `/v3/projects/3e9d2219162a4ee49928ae4dff1da07f/users/c260d36c214a4210bdd6e18e72dea008/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:46.365262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9d2219162a4ee49928ae4dff1da07f, user_id=c260d36c214a4210bdd6e18e72dea008, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:46.365610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282378ec-8146-42ae-b04b-b0dd7d9384a9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:46.388975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:46.399504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:46.400190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:46.400478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:46.400752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:46.408474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:46.435339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 905/1805] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:46 2022] PUT /identity/v3/projects/3e9d2219162a4ee49928ae4dff1da07f/users/c260d36c214a4210bdd6e18e72dea008/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:46.438225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:46.447071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:46.447263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:46.448828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cf600-ea13-47f1-8fc6-255582fc523a service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:46.492808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 901/1806] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:46.497382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:46.498145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:46.500955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:46.631377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] MFA Rules not processed for user `c260d36c214a4210bdd6e18e72dea008`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:46.642655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:46.664829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427edee-f8ac-43f9-a047-98e6c89a43fb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:46.670341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:46.671189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:46.671767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:46.672316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:46.882249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 902/1807] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:46.888378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:46.927472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:46.928969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:46.969116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 906/1808] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:47.134323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc108-45e5-491e-90b3-b3f06bcf4a7b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:47.143124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:47.144585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.145019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.158291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.159141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:47.162144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:47.216291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 903/1809] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:46 2022] POST /identity/v3/projects => generated 379 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:47.221778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.297388 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee978-0e09-4cfb-af95-b61a44da8339 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:47.373037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.375259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:47.412776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:47.434121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:47.435831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.436297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.436737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.438518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:47.440895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:47.506780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 907/1810] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:47 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:47.514492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.532368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:47.545630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae4b3-7371-41c6-86ff-4b012632bde2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:47.564339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:47.565078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.565307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.565584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.566722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:47.568042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:47.571899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af5c4-16f8-4e81-935a-1748f4d1a559 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:47.580205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:47.581993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.582290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.582738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] PATH_INFO: `/v3/users/0377f09a8ba54dc29e3e4e5f1df0b503` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.597765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 908/1811] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:47.598708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.599143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0377f09a8ba54dc29e3e4e5f1df0b503)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:47.607892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:47.617896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeabb1-238c-411c-bc6d-1eb6a0e0dccd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:47.632101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:47.633551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.633833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.634113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] PATH_INFO: `/v3/projects/b943a052614a42e18e4283b40d6fe515/users/58133f6bb9f748eabc4ba05fc2189cfa/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.670596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b943a052614a42e18e4283b40d6fe515, user_id=58133f6bb9f748eabc4ba05fc2189cfa, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:47.673734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:47.697005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 909/1812] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:47 2022] PUT /identity/v3/projects/b943a052614a42e18e4283b40d6fe515/users/58133f6bb9f748eabc4ba05fc2189cfa/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:47.698510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.710049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0377f09a8ba54dc29e3e4e5f1df0b503'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:47.712340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0377f09a8ba54dc29e3e4e5f1df0b503'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:47.713241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0377f09a8ba54dc29e3e4e5f1df0b503'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:47.736549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0377f09a8ba54dc29e3e4e5f1df0b503'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:47.750430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-da9af096-6ddf-414e-9002-a66958f8d726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0377f09a8ba54dc29e3e4e5f1df0b503'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:47.781759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 904/1813] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:47 2022] DELETE /identity/v3/users/0377f09a8ba54dc29e3e4e5f1df0b503 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:47.784956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.785256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.785688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.820149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f2b5-1cac-40a4-b490-0845a7d6da52 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:47.840230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:47.842555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:47.950587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:47.953182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 905/1814] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:47.953442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.953971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.954201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.955204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:47.964412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:47.984093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 910/1815] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:47.985193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.988456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.003090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:48.006214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.006896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412ec6-a1ab-4454-8c0c-e903d9dbd9d0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:48.013120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:48.014335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.014623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.014895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] PATH_INFO: `/v3/projects/b943a052614a42e18e4283b40d6fe515/users/58133f6bb9f748eabc4ba05fc2189cfa/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.017231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b943a052614a42e18e4283b40d6fe515, user_id=58133f6bb9f748eabc4ba05fc2189cfa, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:48.020235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:48.039473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 906/1816] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:47 2022] PUT /identity/v3/projects/b943a052614a42e18e4283b40d6fe515/users/58133f6bb9f748eabc4ba05fc2189cfa/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:48.039473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:48.044469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01372f9d-ab07-42e6-a0de-27c529d88dde admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:48.048151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.214495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:48.222199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:48.248307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da34516-12de-44f4-b798-c584aeab5255 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:48.250270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:48.251091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.251378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.251676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] PATH_INFO: `/v3/projects/04169d208273430fb2ffc6a6f8cb4684` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.256402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04169d208273430fb2ffc6a6f8cb4684)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:48.261070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:48.270090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259738af-5b8a-40f7-892f-2542206c1869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:48.283959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259738af-5b8a-40f7-892f-2542206c1869 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.287701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259738af-5b8a-40f7-892f-2542206c1869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.288217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259738af-5b8a-40f7-892f-2542206c1869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.321710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259738af-5b8a-40f7-892f-2542206c1869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:48.326719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259738af-5b8a-40f7-892f-2542206c1869 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:48.364332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 907/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:48.365910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.366199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.366404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.373022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04169d208273430fb2ffc6a6f8cb4684', 'request_id': 'req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.387709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04169d208273430fb2ffc6a6f8cb4684', 'request_id': 'req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.405265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04169d208273430fb2ffc6a6f8cb4684', 'request_id': 'req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.452297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] The token cache is being invalidate because project 04169d208273430fb2ffc6a6f8cb4684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:48.454450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.457728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.469774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 911/1818] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:48 2022] DELETE /identity/v3/projects/04169d208273430fb2ffc6a6f8cb4684 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:48.469774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:48.471254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] MFA Rules not processed for user `58133f6bb9f748eabc4ba05fc2189cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:48.473311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.474005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.696885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06ffb9-1da1-4c9d-aa86-c8effda5ceb4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:48.706358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 908/1819] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:48.721651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:48.722775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:48.723707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.723987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.724266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] PATH_INFO: `/v3/users/e352524204df4e5490f22600e5668f0d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.727785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.729595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e352524204df4e5490f22600e5668f0d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:48.731919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:48.856248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efd203-538d-4df4-abdf-26e1f83d8c85 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:48.857930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e352524204df4e5490f22600e5668f0d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.860123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e352524204df4e5490f22600e5668f0d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.863412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e352524204df4e5490f22600e5668f0d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.867766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:48.873572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.873854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.874134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.895450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e352524204df4e5490f22600e5668f0d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.898154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.905836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be6150c4-d227-407f-9da2-abd330c838a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e352524204df4e5490f22600e5668f0d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:48.924508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:48.945628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 912/1820] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:48 2022] DELETE /identity/v3/users/e352524204df4e5490f22600e5668f0d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:48.965125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50672-31af-4971-9cc0-fd682a12b814 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.965437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50672-31af-4971-9cc0-fd682a12b814 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.965632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50672-31af-4971-9cc0-fd682a12b814 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.967266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 913/1821] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:49.020708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:49.020994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:49.021273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:49.052172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:49.053665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860e4b-daea-49aa-87a0-ce8c5fe12ef2 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:49.074910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:49.082108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:49.115514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 909/1822] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:49.117113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:49.117461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:49.117741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:49.162964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] MFA Rules not processed for user `d9d24a461bf543148b3c0e45a9d2006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:49.167337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:49.214477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:49.264866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 914/1823] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:49.313822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 910/1824] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:50.329463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:50.330899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.358609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32cdcb-fd3c-40b2-924d-f751958d6cd2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:50.367270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:50.368939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.369823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.370570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.386781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:50.389315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.400585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:50.404309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:50.433726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 915/1825] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:50.455187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:50.459704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.589577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070841c-074d-424b-87e1-be3bd3c652a5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:50.597430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:50.598657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.599041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.599432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] PATH_INFO: `/v3/projects/7895e70e86804873b2953edb6261ae49` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.601179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7895e70e86804873b2953edb6261ae49)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:50.605834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:50.613524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ce35-7090-40a9-ae32-d8537fa1f2a2 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:50.623307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:50.624493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.624943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.625326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] PATH_INFO: `/v3/projects/1b05e47d30c34b709b72f9822f0a8de0` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.626727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b05e47d30c34b709b72f9822f0a8de0)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:50.628837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:50.694838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7895e70e86804873b2953edb6261ae49', 'request_id': 'req-73ca2515-e50c-441a-af7e-37be03a72e60'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.732125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7895e70e86804873b2953edb6261ae49', 'request_id': 'req-73ca2515-e50c-441a-af7e-37be03a72e60'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.736459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b05e47d30c34b709b72f9822f0a8de0', 'request_id': 'req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.746609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7895e70e86804873b2953edb6261ae49', 'request_id': 'req-73ca2515-e50c-441a-af7e-37be03a72e60'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.755026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b05e47d30c34b709b72f9822f0a8de0', 'request_id': 'req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.768211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b05e47d30c34b709b72f9822f0a8de0', 'request_id': 'req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.790762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] The token cache is being invalidate because project 1b05e47d30c34b709b72f9822f0a8de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:50.791221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.794543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.796707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 916/1826] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:50 2022] DELETE /identity/v3/projects/1b05e47d30c34b709b72f9822f0a8de0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:50.801065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:50.804534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.817297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] The token cache is being invalidate because project 7895e70e86804873b2953edb6261ae49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:50.817588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.818708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:50.825817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 911/1827] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:50 2022] DELETE /identity/v3/projects/7895e70e86804873b2953edb6261ae49 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:50.826888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:50.831000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:50.835178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.982954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc6777-c2ee-4cff-8bdb-2258dc6a82f5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:50.988804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:50.990810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.991179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.991581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] PATH_INFO: `/v3/users/67ad749852614818b0feaa28bb00c90e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.993824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ad749852614818b0feaa28bb00c90e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:50.996342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:50.997730 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca2515-e50c-441a-af7e-37be03a72e60 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:51.038474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:51.088052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ad749852614818b0feaa28bb00c90e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.089297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ad749852614818b0feaa28bb00c90e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.092310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ad749852614818b0feaa28bb00c90e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.120732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ad749852614818b0feaa28bb00c90e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.126439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:51.126821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:51.127110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:51.127403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:51.132862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:51.133603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-44df60b4-a2da-4295-bb6a-f7512cf16ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ad749852614818b0feaa28bb00c90e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.154693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 917/1828] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:50 2022] DELETE /identity/v3/users/67ad749852614818b0feaa28bb00c90e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:51.156645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75485-10ff-44c5-a556-42bee909a78b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:51.156939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75485-10ff-44c5-a556-42bee909a78b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:51.157218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75485-10ff-44c5-a556-42bee909a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:51.186469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a4b75485-10ff-44c5-a556-42bee909a78b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:51.187470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a4b75485-10ff-44c5-a556-42bee909a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:51.295637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:51.296242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:51.322876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 912/1829] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:51.324107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:51.329704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:51.340662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 918/1830] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:51.351289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:51.351615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:51.352481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:51.361260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb0a37-1708-4ccb-8aca-620373d9f534 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:51.366449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:51.367927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:51.368194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:51.368479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] PATH_INFO: `/v3/projects/1ff72f9c6ade4d16ac42822d5c3ceb1f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:51.372515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff72f9c6ade4d16ac42822d5c3ceb1f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:51.376895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:51.396409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:51.397726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:51.419497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 919/1831] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:51.423832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:51.439166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119222-842a-461e-a6ff-3ded5c09728f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:51.455434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:51.456130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:51.456399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:51.457517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:51.458616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:51.458791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:51.462956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:51.489854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff72f9c6ade4d16ac42822d5c3ceb1f', 'request_id': 'req-59100037-576b-41d7-a566-66ad7884aae6'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.511087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 920/1832] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:51.512157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:51.524971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c68f-5970-420e-bce3-4e5ea0adf876 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:51.536000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff72f9c6ade4d16ac42822d5c3ceb1f', 'request_id': 'req-59100037-576b-41d7-a566-66ad7884aae6'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.537909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:51.579814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff72f9c6ade4d16ac42822d5c3ceb1f', 'request_id': 'req-59100037-576b-41d7-a566-66ad7884aae6'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.607866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] The token cache is being invalidate because project 1ff72f9c6ade4d16ac42822d5c3ceb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:51.608152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.612677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:51.615974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 913/1833] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:51 2022] DELETE /identity/v3/projects/1ff72f9c6ade4d16ac42822d5c3ceb1f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:51.620510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:51.622755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:51.678449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:51.679282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:51.680369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:51.680709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:51.682334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:51.695272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:51.779938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 921/1834] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:51 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:51.782462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:51.783183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:51.787457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:51.837516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59100037-576b-41d7-a566-66ad7884aae6 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.000604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.001645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.001940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.002222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] PATH_INFO: `/v3/users/e9647606ea1f40a6914d86fd0a496449` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.003485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9647606ea1f40a6914d86fd0a496449)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.004547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526ea0-b64d-4179-a482-4e511dcc83c6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.005608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.021437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.022788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.023372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.024451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] PATH_INFO: `/v3/projects/fbd2f557cf1d4f668f7e9a8d37795d3a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.025970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd2f557cf1d4f668f7e9a8d37795d3a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.028794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.125129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9647606ea1f40a6914d86fd0a496449'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.125886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9647606ea1f40a6914d86fd0a496449'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.126526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9647606ea1f40a6914d86fd0a496449'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.127278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd2f557cf1d4f668f7e9a8d37795d3a', 'request_id': 'req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.143604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9647606ea1f40a6914d86fd0a496449'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.155672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd2f557cf1d4f668f7e9a8d37795d3a', 'request_id': 'req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.164514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9647606ea1f40a6914d86fd0a496449'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.174206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd2f557cf1d4f668f7e9a8d37795d3a', 'request_id': 'req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.183829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 914/1835] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:51 2022] DELETE /identity/v3/users/e9647606ea1f40a6914d86fd0a496449 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:52.184784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.186414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:52.193517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] The token cache is being invalidate because project fbd2f557cf1d4f668f7e9a8d37795d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:52.195193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.198734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6a153b09-0ac2-4c0b-8074-eda9bda14ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:52.201402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 922/1836] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:51 2022] DELETE /identity/v3/projects/fbd2f557cf1d4f668f7e9a8d37795d3a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:52.208165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4ed7-b546-4c70-ba1c-b853cc0efbd2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.208538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4ed7-b546-4c70-ba1c-b853cc0efbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.208889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4ed7-b546-4c70-ba1c-b853cc0efbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.236448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d03e4ed7-b546-4c70-ba1c-b853cc0efbd2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:52.237916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d03e4ed7-b546-4c70-ba1c-b853cc0efbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:52.280216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:52.308674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca737-8954-476e-8013-2e2e1123c450 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.313757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.314453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.314743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.315020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.315935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.318053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.363686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 915/1837] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:52.368505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.372916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:52.386328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:52.391939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86a5c-aaa2-4ec1-aaf2-039765cab235 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.393699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 923/1838] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:52.402999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.403658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.403981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.405200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.406349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.406798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.407445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.408781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.411069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.432650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 916/1839] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:52.435254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.436090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:52.438305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:52.449087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 924/1840] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:52.453062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e144-29e1-4452-adfb-1f4ab441f8b4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.454621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.458607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.459652 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.460287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.460867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.461805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.463933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.465841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd03b5-7297-4ded-b7b1-66a553b7e973 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.472691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.473472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.473653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.473936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.474676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:52.475264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.477792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.499995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 925/1841] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:52.501702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.503299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 917/1842] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:52.507727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.515048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28575-64cb-4ecf-988a-b10a8d15398e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.520927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.521605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.521893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.522169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.523243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf24fb-d8e2-4664-8fe3-ae943f8b6a83 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.524267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.526227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.538196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43739edd-3c8a-480f-867a-509c7129d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.541918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739edd-3c8a-480f-867a-509c7129d8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.542447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739edd-3c8a-480f-867a-509c7129d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.542899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739edd-3c8a-480f-867a-509c7129d8e8 admin admin] PATH_INFO: `/v3/projects/f1e4d092c44e4f06821b039f79aaf866/users/0f295b9f895a4f6fa775d031a378db90/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.574243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 926/1843] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:52.576000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.585380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43739edd-3c8a-480f-867a-509c7129d8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e4d092c44e4f06821b039f79aaf866, user_id=0f295b9f895a4f6fa775d031a378db90, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.588645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43739edd-3c8a-480f-867a-509c7129d8e8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.615830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 918/1844] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:52 2022] PUT /identity/v3/projects/f1e4d092c44e4f06821b039f79aaf866/users/0f295b9f895a4f6fa775d031a378db90/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:52.628175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.629308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.629747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.676513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84e36-4825-4554-a010-dcaeeda6855b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.707606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] MFA Rules not processed for user `0f295b9f895a4f6fa775d031a378db90`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:52.708846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:52.765902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.767081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.767773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.768232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.769383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.772931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.810783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 927/1845] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:52.816359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.847192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e973ea-658b-4952-a859-3e6fd487f5ce admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.848871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 919/1846] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:52.855206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.857030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:52.857826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.858823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.859327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.860277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.861418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.863485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.918188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 928/1847] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:52.919142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:52.924041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c3d3a-50b3-494c-abdd-be36b50e96c2 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.933162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.934051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.934645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.934931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] PATH_INFO: `/v3/projects/6456b71196cc46879466bdf26d977f87` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.936222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6456b71196cc46879466bdf26d977f87)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.938691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:52.955741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609c94-287d-47d1-aa71-c09402a296f5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:52.984079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:52.984778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:52.985067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:52.985354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:52.986065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:52.990304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.000067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:53.039980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6456b71196cc46879466bdf26d977f87', 'request_id': 'req-f73dee61-cf84-4542-aca9-5774768475b4'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:53.043506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 929/1848] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:52 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:53.047695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.062563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6456b71196cc46879466bdf26d977f87', 'request_id': 'req-f73dee61-cf84-4542-aca9-5774768475b4'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:53.077595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6456b71196cc46879466bdf26d977f87', 'request_id': 'req-f73dee61-cf84-4542-aca9-5774768475b4'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:53.105176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] The token cache is being invalidate because project 6456b71196cc46879466bdf26d977f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:53.105408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:53.106491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:53.111792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 920/1849] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:52 2022] DELETE /identity/v3/projects/6456b71196cc46879466bdf26d977f87 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:53.117137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.119479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.138966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a529dd-51b7-4b1c-a29d-d994195d869a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.144246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2428c0c-a1da-4bdf-bcb6-03f2573a890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.144929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2428c0c-a1da-4bdf-bcb6-03f2573a890e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.145213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2428c0c-a1da-4bdf-bcb6-03f2573a890e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.145484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2428c0c-a1da-4bdf-bcb6-03f2573a890e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.146328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2428c0c-a1da-4bdf-bcb6-03f2573a890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.148005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2428c0c-a1da-4bdf-bcb6-03f2573a890e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.162803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 930/1850] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:53.164847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.165142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.165420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.168336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:53.194640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:53.196201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.213011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 931/1851] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:53.214499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.215453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.218416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dee61-cf84-4542-aca9-5774768475b4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.224366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d662160-2c42-4608-a2b4-bc401dcb5da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.225394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d662160-2c42-4608-a2b4-bc401dcb5da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.225741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d662160-2c42-4608-a2b4-bc401dcb5da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.226079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d662160-2c42-4608-a2b4-bc401dcb5da0 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.227378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d662160-2c42-4608-a2b4-bc401dcb5da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.229580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d662160-2c42-4608-a2b4-bc401dcb5da0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.238335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776089e-6fd7-4288-8a87-94c3131cacd9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.244795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.246054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.246384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.246687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] PATH_INFO: `/v3/projects/dc48da98ace04a458526ac19eb682451/users/1aae903f29244cdda22b0625cedb009c/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.257770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 921/1852] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:53.260085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a0f5-776d-46b1-a4cf-931f718b44ab None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.261042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a0f5-776d-46b1-a4cf-931f718b44ab None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.261897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a0f5-776d-46b1-a4cf-931f718b44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.271792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc48da98ace04a458526ac19eb682451, user_id=1aae903f29244cdda22b0625cedb009c, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.275885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.305760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 932/1853] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:53 2022] PUT /identity/v3/projects/dc48da98ace04a458526ac19eb682451/users/1aae903f29244cdda22b0625cedb009c/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:53.306865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.310641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6e07a0f5-776d-46b1-a4cf-931f718b44ab None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:53.311896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6e07a0f5-776d-46b1-a4cf-931f718b44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.423412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 922/1854] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:53.423412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.423412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.423412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.442198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2995-8d9c-4b85-800e-d4a88facb590 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.455584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.456277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.456451 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] MFA Rules not processed for user `1aae903f29244cdda22b0625cedb009c`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:53.456564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.456823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.457581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.458358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.459985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.477857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 933/1855] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:53.478808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.497442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844ac5-9467-490a-bb34-9dbc31d15918 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.514853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.516083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.516457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.517572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.518170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:53.518496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.530140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.535145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 923/1856] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:53.540999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.553419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024dd6-c6b0-4676-8edd-2324086640f0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.558969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.560533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.560939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.561315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] PATH_INFO: `/v3/projects/560470a589034458b75481052398d923/users/58f9ad88ee4144b6be5b75e2538ced73/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.567920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 934/1857] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:53.571007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.591540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963a63a-139f-49b5-b270-6a6e6ae6aac5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.592806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560470a589034458b75481052398d923, user_id=58f9ad88ee4144b6be5b75e2538ced73, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.595696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.608643 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.609368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.609599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.609881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.610613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.612733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.622004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 924/1858] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:53 2022] PUT /identity/v3/projects/560470a589034458b75481052398d923/users/58f9ad88ee4144b6be5b75e2538ced73/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:53.622927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.659974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 935/1859] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:53.660722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.664591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:53.684154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:53.712576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82167d9-8df1-437e-8934-b58c6558e226 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.767574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9320-0d1a-49c1-83aa-2e86d0d8880d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.783150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.784007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.784442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.784775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.785368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.785501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.786536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.786830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.787103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.787467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.803654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.805613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.824347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 936/1860] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:53.829823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.838433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 925/1861] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:53.838433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.845603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd73c0c-9675-43cb-9a45-33ac5fd618da admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.944272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.945234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.946902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.947255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.947616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46eab-76d9-4751-832f-d00cac454e4c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.949190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.953033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.962183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.964538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.965543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.966052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] PATH_INFO: `/v3/projects/560470a589034458b75481052398d923/users/58f9ad88ee4144b6be5b75e2538ced73/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.972544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560470a589034458b75481052398d923, user_id=58f9ad88ee4144b6be5b75e2538ced73, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.977997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.004949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 937/1862] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:54.011960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.023071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 926/1863] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:53 2022] PUT /identity/v3/projects/560470a589034458b75481052398d923/users/58f9ad88ee4144b6be5b75e2538ced73/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:54.023071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.033743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9500-dc79-420a-b7b1-6a441f6523d5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.109929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:54.125243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368fa6-4cce-40b2-8e6b-4cc823c07217 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.129198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.129932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.130214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.130519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.133716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8855da-0b8e-432e-a0ce-70066e35b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.134226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.134810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8855da-0b8e-432e-a0ce-70066e35b306 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.135285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8855da-0b8e-432e-a0ce-70066e35b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.135781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8855da-0b8e-432e-a0ce-70066e35b306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.136209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.137133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8855da-0b8e-432e-a0ce-70066e35b306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.139144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8855da-0b8e-432e-a0ce-70066e35b306 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.153134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 927/1864] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:54.155247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.155757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.156218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.190651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 938/1865] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:54 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:54.191743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.217355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83998d3-ca53-4e52-a367-6f4b90e9dd64 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.221613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] MFA Rules not processed for user `58f9ad88ee4144b6be5b75e2538ced73`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:54.222720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.223101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:54.223731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.224080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.224376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.225748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.228259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.244327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 939/1866] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:54.246088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.260956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e406c22-9554-41f8-8879-f09c7f4a1b5d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.267684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.268648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.269571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.269923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.270934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.272603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.292412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 940/1867] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:54.292412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.306354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611970c7-2f14-49c2-8e41-01fbfce7a14b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.315072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.316571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.316864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.317148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] PATH_INFO: `/v3/projects/3aa63ca3b41b42eda55466ce02ee25fa/users/90599bafb78a4948a1cb95a6c97c92b7/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.322194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:54.342452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 928/1868] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:54.343755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.363717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa63ca3b41b42eda55466ce02ee25fa, user_id=90599bafb78a4948a1cb95a6c97c92b7, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.368657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.379557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9056a1-927f-4d5a-9b4d-a4ba71c28a2e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.396015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 941/1869] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:54 2022] PUT /identity/v3/projects/3aa63ca3b41b42eda55466ce02ee25fa/users/90599bafb78a4948a1cb95a6c97c92b7/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:54.396015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.396015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:54.492760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ed77-79fb-48fc-b00d-2c60d133f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.493924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ed77-79fb-48fc-b00d-2c60d133f78d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.494966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ed77-79fb-48fc-b00d-2c60d133f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.496228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ed77-79fb-48fc-b00d-2c60d133f78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.497777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ed77-79fb-48fc-b00d-2c60d133f78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.504503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ed77-79fb-48fc-b00d-2c60d133f78d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.519965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34a74-d3aa-4f28-a245-682d0c0096cb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.533867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 929/1870] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:54.540151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.540707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.540707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.545342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.546091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.546363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.546782 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.557991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:54.617427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] MFA Rules not processed for user `90599bafb78a4948a1cb95a6c97c92b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:54.618667 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:54.687911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.689612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.706384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 942/1871] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:54.709046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.763916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580660-a660-4d0a-a942-6b4685dca4ea service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.778500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf744969-a243-408c-b001-c6c3cbb724f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.782076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744969-a243-408c-b001-c6c3cbb724f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.782348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744969-a243-408c-b001-c6c3cbb724f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.782641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744969-a243-408c-b001-c6c3cbb724f3 admin admin] PATH_INFO: `/v3/projects/f9238f27acb148379907b72d0ef87b47/users/4b43ee4c3ccf4707a115c3fc583620b1/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.850448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 930/1872] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:54.859525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:54.860816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:54.863735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf744969-a243-408c-b001-c6c3cbb724f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9238f27acb148379907b72d0ef87b47, user_id=4b43ee4c3ccf4707a115c3fc583620b1, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.874020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf744969-a243-408c-b001-c6c3cbb724f3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.886129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312818-5770-4aae-a6db-048e5afd53f8 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:54.905457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:54.905457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.905457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.905844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:54.907893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:54.914992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:54.925831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 943/1873] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:54 2022] PUT /identity/v3/projects/f9238f27acb148379907b72d0ef87b47/users/4b43ee4c3ccf4707a115c3fc583620b1/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:54.937781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:54.941104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:54.941697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.012727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 931/1874] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:54 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:55.016821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.032602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] MFA Rules not processed for user `4b43ee4c3ccf4707a115c3fc583620b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:55.034069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:55.126056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 944/1875] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:55.145584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.147295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:55.155080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:55.182482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef4b3-031b-44dc-95ab-dca0123160ba admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.188988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.189675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.197987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.198838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.199642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.202248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.248948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 932/1876] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:55 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:55.252711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.274149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef234-5ab0-433e-bf4b-e89f1e8157ff admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.279617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e2a3-3edd-4582-bcf0-0f2068bb31ef None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.280614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.281636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.281636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.281865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.282573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.284287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.286369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.287322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.287895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.288673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.299984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.300727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 933/1877] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:43:55.302218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.305016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.316816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 945/1878] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:55.319074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169620c6-ed8b-49a2-86e3-f5e8b114a4ca admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.326964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.327925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.328253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.328544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] PATH_INFO: `/v3/projects/1b95da83876d430796b19575c3c1f879/users/4e06fd1f06a248369882080ccc6dd675/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.347118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.364509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff24ea-ccc4-4a9d-a85a-99540e402431 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.367339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b95da83876d430796b19575c3c1f879, user_id=4e06fd1f06a248369882080ccc6dd675, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.370867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.372894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.374118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.374504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.375688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] PATH_INFO: `/v3/users/4b43ee4c3ccf4707a115c3fc583620b1` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.376780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b43ee4c3ccf4707a115c3fc583620b1)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.379253 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.395925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 934/1879] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:55 2022] PUT /identity/v3/projects/1b95da83876d430796b19575c3c1f879/users/4e06fd1f06a248369882080ccc6dd675/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:55.402168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.504131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b43ee4c3ccf4707a115c3fc583620b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:55.505607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b43ee4c3ccf4707a115c3fc583620b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:55.507500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b43ee4c3ccf4707a115c3fc583620b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:55.555731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b43ee4c3ccf4707a115c3fc583620b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:55.564403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a20f8e-aed6-41de-a741-27f10293cacb admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.575081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d80fba91-5e34-41a7-9ef0-0a082440efd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b43ee4c3ccf4707a115c3fc583620b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:55.579692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.581676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.582524 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.582802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.584889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.589886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.611771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 946/1880] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:55 2022] DELETE /identity/v3/users/4b43ee4c3ccf4707a115c3fc583620b1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:55.615638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 935/1881] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:55.619044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.620673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.620933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.621396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.622398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:55.637873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef790e-813e-49ee-b512-a5607d3a1911 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.644943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:55.646144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:55.668942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:55.716733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ba13-53cd-4594-bc36-244759cfd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.717985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ba13-53cd-4594-bc36-244759cfd362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.718993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ba13-53cd-4594-bc36-244759cfd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.720067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ba13-53cd-4594-bc36-244759cfd362 admin admin] PATH_INFO: `/v3/projects/1b95da83876d430796b19575c3c1f879/users/4e06fd1f06a248369882080ccc6dd675/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.724090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3ba13-53cd-4594-bc36-244759cfd362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b95da83876d430796b19575c3c1f879, user_id=4e06fd1f06a248369882080ccc6dd675, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.729226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3ba13-53cd-4594-bc36-244759cfd362 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.730036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 947/1882] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:55.740610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:55.742027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:55.743432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 936/1883] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:55 2022] PUT /identity/v3/projects/1b95da83876d430796b19575c3c1f879/users/4e06fd1f06a248369882080ccc6dd675/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:55.757065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.757308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.757620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.770164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:55.825216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a3e0b-79ec-4a03-806f-6b6fb844088b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:55.834268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] MFA Rules not processed for user `4e06fd1f06a248369882080ccc6dd675`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:55.837931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:55.890572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:55.892497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.892497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.892820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.981160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:55.982632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:55.998203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 948/1884] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:55.999067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.000476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.002876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 937/1885] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:56.014480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.015961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8370403-c47f-4675-be45-46f23025b792 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.016131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.021753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.022789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.023080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.023362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] PATH_INFO: `/v3/users/c260d36c214a4210bdd6e18e72dea008` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.025047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c260d36c214a4210bdd6e18e72dea008)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.027139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:56.096293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64463-2ee2-4e21-b7a2-bce56e9747ee None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.101038 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf01d65-e9b9-4431-9a9d-2468a3a702d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.102394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01d65-e9b9-4431-9a9d-2468a3a702d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.102778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01d65-e9b9-4431-9a9d-2468a3a702d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.103295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01d65-e9b9-4431-9a9d-2468a3a702d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.105247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c260d36c214a4210bdd6e18e72dea008'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.106659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c260d36c214a4210bdd6e18e72dea008'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.107307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c260d36c214a4210bdd6e18e72dea008'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.115095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01d65-e9b9-4431-9a9d-2468a3a702d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.116723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01d65-e9b9-4431-9a9d-2468a3a702d4 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:56.126134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c260d36c214a4210bdd6e18e72dea008'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.131500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 938/1886] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:56.136295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c260d36c214a4210bdd6e18e72dea008'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.143112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:56.162362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 949/1887] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:55 2022] DELETE /identity/v3/users/c260d36c214a4210bdd6e18e72dea008 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:56.167361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.167962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.168513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.206404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:56.207688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.276442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:56.300601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 939/1888] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:56.318644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.320088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.439611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7716a-cdde-458a-98a2-42aea89bef15 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.443268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195f9f5-70b9-462b-94e5-b49fecb52405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.444045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f9f5-70b9-462b-94e5-b49fecb52405 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.444342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f9f5-70b9-462b-94e5-b49fecb52405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.444605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f9f5-70b9-462b-94e5-b49fecb52405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.458686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195f9f5-70b9-462b-94e5-b49fecb52405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.460379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195f9f5-70b9-462b-94e5-b49fecb52405 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:56.464755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.467522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.475628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 950/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:56.487942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f871bd-2b2d-4a65-aec1-b5f5006b724d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.494809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.496377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.496672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.496958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] PATH_INFO: `/v3/projects/f9238f27acb148379907b72d0ef87b47` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.498347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9238f27acb148379907b72d0ef87b47)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.500322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:56.570106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9238f27acb148379907b72d0ef87b47', 'request_id': 'req-eae2a8d6-4869-4f87-98ed-a1692dd35e69'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.597423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9238f27acb148379907b72d0ef87b47', 'request_id': 'req-eae2a8d6-4869-4f87-98ed-a1692dd35e69'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.608221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9238f27acb148379907b72d0ef87b47', 'request_id': 'req-eae2a8d6-4869-4f87-98ed-a1692dd35e69'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.625535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] The token cache is being invalidate because project f9238f27acb148379907b72d0ef87b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:56.625826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.626511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-eae2a8d6-4869-4f87-98ed-a1692dd35e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:56.629370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 940/1890] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:56 2022] DELETE /identity/v3/projects/f9238f27acb148379907b72d0ef87b47 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:56.634389 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.634972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.635077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.663257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:56.665454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.770033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 951/1891] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:56.782545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.783135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.783479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.826073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:56.827489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.837725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 941/1892] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:56.842789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.855236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca711e5-21f2-4918-b2b4-98b12620e2eb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.860404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.861099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.861385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.861665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.862624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:56.863610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.864838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:56.883728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.888869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 952/1893] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:56.894431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b96f5-e30e-46cd-b680-f6f10dc5210a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.900338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.901017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.901304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.902050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.902286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.932114 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.035711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 942/1894] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:56 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:57.035932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.051412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda57c9-9a15-42b0-b7c4-aee0de54f09b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.063738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.065934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:57.175889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924ef3-1d93-4ff1-8fce-799ac0cd0068 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.182200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:57.186401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.187053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.187590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.190211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:57.222099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:57.222822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.223222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.223550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.224260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:57.226487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.288814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 953/1895] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:57 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:57.289983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.293179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:57.295875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:57.296328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.303125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:57.314200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 943/1896] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:57.315514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.329989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461f0a-8263-4cce-a42e-63800c3cdb9b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.339558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7e31-17b0-45ac-b7e1-58d6b6e3cf05 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.340401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:57.341353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.341638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.343545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] PATH_INFO: `/v3/projects/3e9d2219162a4ee49928ae4dff1da07f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.346367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9d2219162a4ee49928ae4dff1da07f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:57.348489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:57.349593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.350708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.351448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.352383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.353684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:57.356224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.376390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:57.378145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 944/1897] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:57.384211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.420452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608327e-0975-42ed-bb42-eba568c0ea3d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.438517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:57.439348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.440272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.440457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.442582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:57.450010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.476535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 945/1898] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:57.481576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.496898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85be8da-9dc6-4046-8114-0940e3403369 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.534027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9d2219162a4ee49928ae4dff1da07f', 'request_id': 'req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:57.557433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9d2219162a4ee49928ae4dff1da07f', 'request_id': 'req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:57.574669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9d2219162a4ee49928ae4dff1da07f', 'request_id': 'req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:57.607992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] The token cache is being invalidate because project 3e9d2219162a4ee49928ae4dff1da07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:57.608364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:57.610613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:57.613520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 954/1899] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:57 2022] DELETE /identity/v3/projects/3e9d2219162a4ee49928ae4dff1da07f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:57.617437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.621568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:57.643157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefecd1-3521-4ea4-b74a-84fb960af8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:57.644809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefecd1-3521-4ea4-b74a-84fb960af8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.645786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefecd1-3521-4ea4-b74a-84fb960af8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.646968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefecd1-3521-4ea4-b74a-84fb960af8eb admin admin] PATH_INFO: `/v3/projects/2f4475c7f2104aa0b7daf51eaf9581eb/users/d7df511ca53345368fdf65bc47ccb85b/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.678227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefecd1-3521-4ea4-b74a-84fb960af8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4475c7f2104aa0b7daf51eaf9581eb, user_id=d7df511ca53345368fdf65bc47ccb85b, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:57.682995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefecd1-3521-4ea4-b74a-84fb960af8eb admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:57.723909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 946/1900] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:57 2022] PUT /identity/v3/projects/2f4475c7f2104aa0b7daf51eaf9581eb/users/d7df511ca53345368fdf65bc47ccb85b/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:57.726217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d55f-0db3-409f-a4d7-3bb19471b5b5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.726707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d55f-0db3-409f-a4d7-3bb19471b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.727572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d55f-0db3-409f-a4d7-3bb19471b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.777176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-3046d55f-0db3-409f-a4d7-3bb19471b5b5 None None] MFA Rules not processed for user `d7df511ca53345368fdf65bc47ccb85b`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:57.778491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a804a-cd7a-4f1d-be06-afb5b1117af8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:57.778938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3046d55f-0db3-409f-a4d7-3bb19471b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:57.896162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 947/1901] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:57.898285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f519-9bc9-40bb-99b6-d4574d9be049 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:57.898758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f519-9bc9-40bb-99b6-d4574d9be049 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:57.900235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f519-9bc9-40bb-99b6-d4574d9be049 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:57.901806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 948/1902] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:57.903187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f519-9bc9-40bb-99b6-d4574d9be049 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:57.905310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-aa52f519-9bc9-40bb-99b6-d4574d9be049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:57.982920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:58.008646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.009451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.009738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.010103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] PATH_INFO: `/v3/users/58133f6bb9f748eabc4ba05fc2189cfa` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.012411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58133f6bb9f748eabc4ba05fc2189cfa)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.014356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.022649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f519-9bc9-40bb-99b6-d4574d9be049 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.035895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cb990-d8ad-4494-82c5-97d39a21b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.036867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cb990-d8ad-4494-82c5-97d39a21b59c admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.037163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cb990-d8ad-4494-82c5-97d39a21b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.037447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cb990-d8ad-4494-82c5-97d39a21b59c admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.038766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cb990-d8ad-4494-82c5-97d39a21b59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.044508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cb990-d8ad-4494-82c5-97d39a21b59c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.084779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58133f6bb9f748eabc4ba05fc2189cfa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:58.085438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58133f6bb9f748eabc4ba05fc2189cfa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:58.086081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58133f6bb9f748eabc4ba05fc2189cfa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:58.087265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:58.092701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 949/1903] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:57 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:58.092701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.092701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.092701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.104926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58133f6bb9f748eabc4ba05fc2189cfa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:58.112451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58133f6bb9f748eabc4ba05fc2189cfa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:58.113090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:58.114291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.126078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 955/1904] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:43:57 2022] DELETE /identity/v3/users/58133f6bb9f748eabc4ba05fc2189cfa => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:58.126856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.128224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.214012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e896-1767-43ab-86f6-6a3c8ed881e0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.223317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.223758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 950/1905] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:43:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:58.224605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.225444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.226132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.228427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.230836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.243187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.245806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.259408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 956/1906] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:58 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:58.262539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.262539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.323502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436274a-8ecf-460c-932f-f53ff1daa68e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.385342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.386417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.386904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.387483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.390719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac7d4-8e22-4085-b4d3-bfaa93a888bd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.391697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.397824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.399471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.399765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.400050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.413021 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.415282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.430485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 957/1907] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:58.432194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.446206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b5014-81a5-48ef-b9a8-d23219e69364 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.447763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:58.454119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.454953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.455146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.455774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.456585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.459041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.486670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 958/1908] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:58.487615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.490001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.491166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.507589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 951/1909] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:58.508923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f738a9-5d7c-4dab-b4ab-38086d768199 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.514502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.515535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.515885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.516471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] PATH_INFO: `/v3/projects/4d090a252d604d509b3980a1a1f58fed/users/9205c49e574a4971b1ac1158d6ff54f0/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.541614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d090a252d604d509b3980a1a1f58fed, user_id=9205c49e574a4971b1ac1158d6ff54f0, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.544500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.569941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 959/1910] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:58 2022] PUT /identity/v3/projects/4d090a252d604d509b3980a1a1f58fed/users/9205c49e574a4971b1ac1158d6ff54f0/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:58.573527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.592637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727436-3694-4edf-b924-874ad2eacb03 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.692037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9838a-6dda-49a9-ab9e-b1027ccf55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.692824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9838a-6dda-49a9-ab9e-b1027ccf55a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.693020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9838a-6dda-49a9-ab9e-b1027ccf55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.693273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9838a-6dda-49a9-ab9e-b1027ccf55a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.694005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9838a-6dda-49a9-ab9e-b1027ccf55a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.696587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9838a-6dda-49a9-ab9e-b1027ccf55a8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.709345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 952/1911] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:58.714794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.724403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:58.731005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a12ea7-3f29-4993-8e07-380a7091a1c6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.737501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.752876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.753172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.753456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] PATH_INFO: `/v3/projects/4d090a252d604d509b3980a1a1f58fed/users/9205c49e574a4971b1ac1158d6ff54f0/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.756337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d090a252d604d509b3980a1a1f58fed, user_id=9205c49e574a4971b1ac1158d6ff54f0, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:58.760209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:58.794440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 960/1912] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:58 2022] PUT /identity/v3/projects/4d090a252d604d509b3980a1a1f58fed/users/9205c49e574a4971b1ac1158d6ff54f0/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:43:58.796177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.796476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.796757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.857466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] MFA Rules not processed for user `9205c49e574a4971b1ac1158d6ff54f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:58.858902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.002630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.004666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.057704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 953/1913] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:59.084402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.089725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.150022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900a3b4-0fa0-4f16-9242-414b627dcfc8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.162645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.163600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.163881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.164994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] PATH_INFO: `/v3/projects/b943a052614a42e18e4283b40d6fe515` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.166624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b943a052614a42e18e4283b40d6fe515)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.168621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.276142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57218ef6-e695-4729-b6b0-63b51db341dc None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.279103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b943a052614a42e18e4283b40d6fe515', 'request_id': 'req-61ce9b00-5940-489e-8560-dd21c3716353'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:59.293751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:59.298819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b943a052614a42e18e4283b40d6fe515', 'request_id': 'req-61ce9b00-5940-489e-8560-dd21c3716353'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:59.305751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b943a052614a42e18e4283b40d6fe515', 'request_id': 'req-61ce9b00-5940-489e-8560-dd21c3716353'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:59.329451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] The token cache is being invalidate because project b943a052614a42e18e4283b40d6fe515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:43:59.329745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:59.331751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-61ce9b00-5940-489e-8560-dd21c3716353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:43:59.333667 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 961/1914] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:43:59 2022] DELETE /identity/v3/projects/b943a052614a42e18e4283b40d6fe515 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:43:59.338949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bcf8-9baf-4a92-9bd6-85c4495a01c9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.339238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bcf8-9baf-4a92-9bd6-85c4495a01c9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.339552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bcf8-9baf-4a92-9bd6-85c4495a01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.365700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.366720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.367470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.376670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.382116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9619bcf8-9baf-4a92-9bd6-85c4495a01c9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:59.383466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9619bcf8-9baf-4a92-9bd6-85c4495a01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.385840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.589502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 962/1915] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:59.592743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.592875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.593378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.593677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.594972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.607624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 954/1916] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:59.618928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:59.619989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.629776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 963/1917] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:59.634765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.661875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d0ad-c67d-40bb-8520-490ac879d988 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.667675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.668349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.668653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.668932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.669668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:43:59.669979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.671625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.700227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 955/1918] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:43:59.701913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.711921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db73656-33f2-4835-9d0e-22f90356985d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.717132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.717801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.718082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.718366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.719070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.721488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.737994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:59.753871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 964/1919] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:43:59 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:43:59.758746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.769407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99370d-96d7-4d38-adaf-09999e3d1d1b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.834319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.835170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.835562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.836434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.837296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.839318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.866082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 956/1920] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:43:59 2022] POST /identity/v3/users => generated 304 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:43:59.867507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.878282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470940b6-d621-405d-bb7f-e71f731b2cab admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.884338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.885208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.885564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.885938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.886744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.888458 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.930099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 965/1921] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:59.934482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:59.958063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4f36e-9179-40ee-8adc-5b3e2faacee0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:59.974637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e810706-f708-4176-a68a-b59238186386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:59.975631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e810706-f708-4176-a68a-b59238186386 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:59.975922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e810706-f708-4176-a68a-b59238186386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:59.976330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e810706-f708-4176-a68a-b59238186386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:59.977458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e810706-f708-4176-a68a-b59238186386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.978796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e810706-f708-4176-a68a-b59238186386 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.990466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 957/1922] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:43:59.995572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.009352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63370-4243-4747-9d4f-9184c06b341d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.014878 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.015930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.016329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.016679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] PATH_INFO: `/v3/projects/8150542ea7804c11928e6aad3be19bed/users/642e9758ea424e88b763fd36ef56ff7e/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.033206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8150542ea7804c11928e6aad3be19bed, user_id=642e9758ea424e88b763fd36ef56ff7e, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.036039 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.052112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 966/1923] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:43:59 2022] PUT /identity/v3/projects/8150542ea7804c11928e6aad3be19bed/users/642e9758ea424e88b763fd36ef56ff7e/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:00.063414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.063815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.064171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.107243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] MFA Rules not processed for user `642e9758ea424e88b763fd36ef56ff7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:00.108688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:00.132099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:00.202165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 958/1924] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:00.203149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.286877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73775531-abb6-4418-a53e-5418950f8e75 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.296504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.297781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.298137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.298487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.299266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.301308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.329477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 967/1925] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:00 2022] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:00.333583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.345331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd7d5c-a655-4282-8c36-7c41ac82e4aa None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.421993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.422743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.423144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.423904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.424562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.427195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.467971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 959/1926] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:00 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:00.469258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.481024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66a65-da85-4c68-bf5c-b4d083e8649d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.488003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.488923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.489359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.489833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.490887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.493911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.512146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 968/1927] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:00.518035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.552290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4721-a09e-469c-baec-c9ba53e41cff admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.556054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.557467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.557467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.557655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] PATH_INFO: `/v3/projects/9e6a4e5fdef142839ed83940335d1c1d/users/e3645fa1e2d741e3a5b01bd5816bc5e2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.576114 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6a4e5fdef142839ed83940335d1c1d, user_id=e3645fa1e2d741e3a5b01bd5816bc5e2, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.578777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.597741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 960/1928] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:00 2022] PUT /identity/v3/projects/9e6a4e5fdef142839ed83940335d1c1d/users/e3645fa1e2d741e3a5b01bd5816bc5e2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:00.603207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.621952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafb8f6-a65a-451b-9f8e-560b02177a80 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.723120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e20fa2-326b-4241-bef6-076b67dcdd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.723991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e20fa2-326b-4241-bef6-076b67dcdd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.724355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e20fa2-326b-4241-bef6-076b67dcdd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.724727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e20fa2-326b-4241-bef6-076b67dcdd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.726108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e20fa2-326b-4241-bef6-076b67dcdd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.728623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e20fa2-326b-4241-bef6-076b67dcdd41 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.743112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 969/1929] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:00.747649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.764089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349bab-17b6-40c8-8ff8-73b5989cc4b8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:00.769249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:00.770333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.770694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.771157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] PATH_INFO: `/v3/projects/9e6a4e5fdef142839ed83940335d1c1d/users/e3645fa1e2d741e3a5b01bd5816bc5e2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.775297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6a4e5fdef142839ed83940335d1c1d, user_id=e3645fa1e2d741e3a5b01bd5816bc5e2, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:00.778288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:00.790663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 961/1930] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:00 2022] PUT /identity/v3/projects/9e6a4e5fdef142839ed83940335d1c1d/users/e3645fa1e2d741e3a5b01bd5816bc5e2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:00.813398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:00.813702 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:00.813977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:00.846338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] MFA Rules not processed for user `e3645fa1e2d741e3a5b01bd5816bc5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:00.848584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:00.866670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:00.936546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 970/1931] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:00.948078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:00.949802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:01.041981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e7c8-3c00-4865-acc9-dbd27f38914a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:01.047267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:01.047954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:01.048235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:01.048595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:01.059711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:01.061272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:01.072530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 962/1932] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:01.247415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:01.249659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:01.263297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1813f-6266-4e82-aeaa-53c1058895a4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:01.268633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:01.269534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:01.270663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:01.270663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:01.350894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:01.355032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:01.369052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 971/1933] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:02.219490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:02.232791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e363d6-3fab-491e-aea9-d4ee8b075ee7 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:02.239234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:02.241704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:02.250284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:02.251364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:02.251684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:02.251961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:02.255283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:02.278121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:02.327617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad25d4-f261-41bc-a916-d859782267b0 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:02.332286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:02.333257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:02.333603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:02.333948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] PATH_INFO: `/v3/users/d7df511ca53345368fdf65bc47ccb85b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:02.336663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7df511ca53345368fdf65bc47ccb85b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:02.338644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:02.338923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:02.340252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5d230-52cb-40f4-b263-c7875d9c21eb service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:02.353366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 963/1934] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:02.393269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7df511ca53345368fdf65bc47ccb85b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:02.394172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7df511ca53345368fdf65bc47ccb85b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:02.395288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7df511ca53345368fdf65bc47ccb85b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:02.401281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:02.410086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7df511ca53345368fdf65bc47ccb85b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:02.418377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7df511ca53345368fdf65bc47ccb85b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:02.430814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 972/1935] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:02 2022] DELETE /identity/v3/users/d7df511ca53345368fdf65bc47ccb85b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:02.435411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:02.435712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:02.435996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:02.455468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:02.457021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:02.534634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 964/1936] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:02.545730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:02.548118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:02.620321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d755-2032-41b6-921e-faef24864709 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:02.624308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:02.624982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:02.625336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:02.625623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:02.636388 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:02.641379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:02.654944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 973/1937] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:03.222816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:03.224560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:03.270377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64a61-d5a9-4cf6-b094-754da47e75e6 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:03.292476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:03.293725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:03.294320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:03.294799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] PATH_INFO: `/v3/projects/2f4475c7f2104aa0b7daf51eaf9581eb` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:03.298906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4475c7f2104aa0b7daf51eaf9581eb)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:03.302312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:03.405534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4475c7f2104aa0b7daf51eaf9581eb', 'request_id': 'req-917a1a1c-2493-463c-831a-c800028082fe'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.413707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4475c7f2104aa0b7daf51eaf9581eb', 'request_id': 'req-917a1a1c-2493-463c-831a-c800028082fe'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.425660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4475c7f2104aa0b7daf51eaf9581eb', 'request_id': 'req-917a1a1c-2493-463c-831a-c800028082fe'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.440363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] The token cache is being invalidate because project 2f4475c7f2104aa0b7daf51eaf9581eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:03.440363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.441069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.443301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 965/1938] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:03 2022] DELETE /identity/v3/projects/2f4475c7f2104aa0b7daf51eaf9581eb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:03.447818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:03.460189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913df7-17ea-4833-a1ec-039f5f7a5b68 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:03.536741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:03.537636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:03.537917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:03.538201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] PATH_INFO: `/v3/users/9205c49e574a4971b1ac1158d6ff54f0` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:03.539522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9205c49e574a4971b1ac1158d6ff54f0)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:03.541552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:03.603315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9205c49e574a4971b1ac1158d6ff54f0'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.604081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9205c49e574a4971b1ac1158d6ff54f0'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.604734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9205c49e574a4971b1ac1158d6ff54f0'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.618154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9205c49e574a4971b1ac1158d6ff54f0'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.627409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3447a23c-4f2f-4601-a520-38ab56b2c447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9205c49e574a4971b1ac1158d6ff54f0'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:03.632294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:03.643892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 974/1939] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:03 2022] DELETE /identity/v3/users/9205c49e574a4971b1ac1158d6ff54f0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:04.023139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.024814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.038585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1a1c-2493-463c-831a-c800028082fe admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.082011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:04.118704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.119739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.120737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.121398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] PATH_INFO: `/v3/projects/4d090a252d604d509b3980a1a1f58fed` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.122657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d090a252d604d509b3980a1a1f58fed)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.124681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.173268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d090a252d604d509b3980a1a1f58fed', 'request_id': 'req-7ed76ba1-590b-414a-8e0c-081ea78037d2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:04.180563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d090a252d604d509b3980a1a1f58fed', 'request_id': 'req-7ed76ba1-590b-414a-8e0c-081ea78037d2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:04.186188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d090a252d604d509b3980a1a1f58fed', 'request_id': 'req-7ed76ba1-590b-414a-8e0c-081ea78037d2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:04.197889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] The token cache is being invalidate because project 4d090a252d604d509b3980a1a1f58fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:04.198178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:04.198884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7ed76ba1-590b-414a-8e0c-081ea78037d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:04.200941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 966/1940] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:04 2022] DELETE /identity/v3/projects/4d090a252d604d509b3980a1a1f58fed => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:04.205931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.206229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.206513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.227477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:04.228699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.324541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 975/1941] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:04.332538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.333186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.333186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.356920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:04.358088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.368056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 967/1942] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:04.372821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.386076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a9a11-e539-4ba7-b92a-0e19ff8f127f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.394359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.396539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.398732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.398732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.401173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:04.401173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.405730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.428013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 976/1943] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:04.432218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.442433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae1ff-5d04-4e00-9c2b-d21b965188bc None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.449357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.450048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.450314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.450587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.451282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.453227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.510864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 968/1944] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:04 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:04.515513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.533588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3400e-eb79-4a31-afea-26c8a230d076 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.627658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.628387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.629250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.629534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.630682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.632703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.665868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 977/1945] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:04 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:04.666153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.676879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a47a-c151-417b-a8d0-d2ab4ab3947b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.681826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.682620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.682963 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.683251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.684196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.686211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.702430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 969/1946] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:04.702885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.716792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ef98-af4a-4010-b3d9-0b64dadd2a44 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.721794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776efd4f-f1c9-4721-aa36-0c94d88db980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.722819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776efd4f-f1c9-4721-aa36-0c94d88db980 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.723112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776efd4f-f1c9-4721-aa36-0c94d88db980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.723462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776efd4f-f1c9-4721-aa36-0c94d88db980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.724162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776efd4f-f1c9-4721-aa36-0c94d88db980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.727368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776efd4f-f1c9-4721-aa36-0c94d88db980 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.744644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 978/1947] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:04.749068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.760461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614077c-6b8a-49e6-ae17-fb65bbb34a4b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.767255 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.768120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.768413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.769884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] PATH_INFO: `/v3/projects/4403d93d21a04f7e95face079d11b64c/users/9c893d5f5628473da5f3be1d586503a4/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.787421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4403d93d21a04f7e95face079d11b64c, user_id=9c893d5f5628473da5f3be1d586503a4, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.790317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.809835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 970/1948] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:04 2022] PUT /identity/v3/projects/4403d93d21a04f7e95face079d11b64c/users/9c893d5f5628473da5f3be1d586503a4/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:04.825692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.826158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.826522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.872955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] MFA Rules not processed for user `9c893d5f5628473da5f3be1d586503a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:04.874659 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.947666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:04.983597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 979/1949] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:04.990540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.992339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.996182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.997941 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:05.087888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f7f9-1c4e-4688-91c9-0c12035bae0e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:05.093807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97247a1-b07a-4732-a669-550d7c0e0e83 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:05.094827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c04bf5-0dfe-48af-9868-d3d849d9370d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:05.095680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04bf5-0dfe-48af-9868-d3d849d9370d service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:05.096025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04bf5-0dfe-48af-9868-d3d849d9370d service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:05.096316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04bf5-0dfe-48af-9868-d3d849d9370d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:05.099346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:05.100647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:05.100923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:05.101212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] PATH_INFO: `/v3/users/1aae903f29244cdda22b0625cedb009c` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:05.102582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aae903f29244cdda22b0625cedb009c)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:05.104891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:05.109685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c04bf5-0dfe-48af-9868-d3d849d9370d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:05.112622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c04bf5-0dfe-48af-9868-d3d849d9370d service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:05.114811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:05.144257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 980/1950] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:05.186561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aae903f29244cdda22b0625cedb009c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:05.187224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aae903f29244cdda22b0625cedb009c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:05.187917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aae903f29244cdda22b0625cedb009c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:05.203512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aae903f29244cdda22b0625cedb009c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:05.212297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aae903f29244cdda22b0625cedb009c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:05.227975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 971/1951] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:04 2022] DELETE /identity/v3/users/1aae903f29244cdda22b0625cedb009c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:05.232713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:05.233940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:05.234295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:05.254985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:05.256242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:05.336867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 981/1952] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:05.354039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:05.356794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:05.448105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b236-19bf-430f-be46-3007aff4f837 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:05.485718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:05.486474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:05.486869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:05.487218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:05.519966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:05.521931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:05.563869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 972/1953] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:06.080759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:06.082301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:06.117968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d104f-4ffc-4b25-98a4-8d3aae9d47e2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:06.137448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:06.159192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:06.162240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:06.162547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] PATH_INFO: `/v3/projects/dc48da98ace04a458526ac19eb682451` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:06.168261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc48da98ace04a458526ac19eb682451)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:06.176802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:06.325395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc48da98ace04a458526ac19eb682451', 'request_id': 'req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.348772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc48da98ace04a458526ac19eb682451', 'request_id': 'req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.359705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc48da98ace04a458526ac19eb682451', 'request_id': 'req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.375978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] The token cache is being invalidate because project dc48da98ace04a458526ac19eb682451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:06.376506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.377392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.383903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 982/1954] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:06 2022] DELETE /identity/v3/projects/dc48da98ace04a458526ac19eb682451 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:06.384962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:06.396362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99893b8a-fa71-4d68-a8ee-26cf0b6b454b service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:06.480939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:06.481867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:06.482150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:06.482421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] PATH_INFO: `/v3/users/90599bafb78a4948a1cb95a6c97c92b7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:06.483658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90599bafb78a4948a1cb95a6c97c92b7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:06.485854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:06.517465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:06.540927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90599bafb78a4948a1cb95a6c97c92b7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.541581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90599bafb78a4948a1cb95a6c97c92b7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.542185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90599bafb78a4948a1cb95a6c97c92b7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.560058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90599bafb78a4948a1cb95a6c97c92b7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.569346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90599bafb78a4948a1cb95a6c97c92b7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:06.588323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 973/1955] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:06 2022] DELETE /identity/v3/users/90599bafb78a4948a1cb95a6c97c92b7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:07.459569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:07.461562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:07.469015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:07.471975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:07.475367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc53e-4e59-490b-8aa6-2661c35b18b6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:07.491869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:07.576251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:07.577159 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:07.577452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:07.577735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] PATH_INFO: `/v3/users/642e9758ea424e88b763fd36ef56ff7e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:07.579053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642e9758ea424e88b763fd36ef56ff7e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:07.580966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:07.634208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1109b-95bc-4d31-83d1-7c4f3eeb3f94 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:07.640200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:07.641199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:07.641479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:07.641902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] PATH_INFO: `/v3/projects/3aa63ca3b41b42eda55466ce02ee25fa` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:07.643454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa63ca3b41b42eda55466ce02ee25fa)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:07.645445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:07.660126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642e9758ea424e88b763fd36ef56ff7e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.661729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642e9758ea424e88b763fd36ef56ff7e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.666720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642e9758ea424e88b763fd36ef56ff7e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.693083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642e9758ea424e88b763fd36ef56ff7e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.708908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26fc4bbe-d68f-4a94-a93c-ab92261c3270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642e9758ea424e88b763fd36ef56ff7e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.743747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa63ca3b41b42eda55466ce02ee25fa', 'request_id': 'req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.748846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 983/1956] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:07 2022] DELETE /identity/v3/users/642e9758ea424e88b763fd36ef56ff7e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:07.753578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:07.753716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:07.753987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:07.761811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa63ca3b41b42eda55466ce02ee25fa', 'request_id': 'req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.772980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa63ca3b41b42eda55466ce02ee25fa', 'request_id': 'req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.778801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:07.781097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:07.793459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] The token cache is being invalidate because project 3aa63ca3b41b42eda55466ce02ee25fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:07.793799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.794537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:07.796675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 974/1957] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:07 2022] DELETE /identity/v3/projects/3aa63ca3b41b42eda55466ce02ee25fa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:07.801326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:07.803344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:07.871579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:07.908329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 984/1958] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:07.918354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:07.921174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:07.922580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4c4e-35f0-46f7-96c5-ca3c32f66532 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:07.938917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:07.939682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:07.939970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:07.940893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] PATH_INFO: `/v3/users/4e06fd1f06a248369882080ccc6dd675` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:07.946456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e06fd1f06a248369882080ccc6dd675)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:07.948900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:07.987812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:08.069592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1448f-8717-4d63-97c6-1072e33ff1d4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:08.078653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e06fd1f06a248369882080ccc6dd675'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.079505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e06fd1f06a248369882080ccc6dd675'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.080879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e06fd1f06a248369882080ccc6dd675'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.087636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:08.088301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:08.088586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:08.088863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:08.103839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:08.113766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e06fd1f06a248369882080ccc6dd675'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.126518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:08.128594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:08.131159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e06fd1f06a248369882080ccc6dd675'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.145759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 985/1959] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:08.164433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 975/1960] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:07 2022] DELETE /identity/v3/users/4e06fd1f06a248369882080ccc6dd675 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:08.699749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:08.701699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:08.725905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64b8a-9612-4089-8e65-75465fa558d2 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:08.832280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:08.833842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:08.835685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:08.835685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] PATH_INFO: `/v3/projects/8150542ea7804c11928e6aad3be19bed` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:08.836978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8150542ea7804c11928e6aad3be19bed)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:08.838912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:08.889948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:08.892580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:08.918624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a7ee5-00d5-4be1-9746-9896452121f0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:08.931999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8150542ea7804c11928e6aad3be19bed', 'request_id': 'req-79737fcd-408c-4d61-b02d-9d7646002e1d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.943728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8150542ea7804c11928e6aad3be19bed', 'request_id': 'req-79737fcd-408c-4d61-b02d-9d7646002e1d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.960376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8150542ea7804c11928e6aad3be19bed', 'request_id': 'req-79737fcd-408c-4d61-b02d-9d7646002e1d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.982658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] The token cache is being invalidate because project 8150542ea7804c11928e6aad3be19bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:08.983032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.983858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:08.987641 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 986/1961] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:08 2022] DELETE /identity/v3/projects/8150542ea7804c11928e6aad3be19bed => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:08.989093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:08.989375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:08.990166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:08.990522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:08.990913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] PATH_INFO: `/v3/projects/1b95da83876d430796b19575c3c1f879` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:08.991086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:08.993165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b95da83876d430796b19575c3c1f879)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:08.995663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.006929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79737fcd-408c-4d61-b02d-9d7646002e1d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.015957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.017089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.017793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.017793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] PATH_INFO: `/v3/users/e3645fa1e2d741e3a5b01bd5816bc5e2` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.020124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3645fa1e2d741e3a5b01bd5816bc5e2)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.023930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.056227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b95da83876d430796b19575c3c1f879', 'request_id': 'req-708be234-8a87-404a-92fb-f9a357b874c4'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.067454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b95da83876d430796b19575c3c1f879', 'request_id': 'req-708be234-8a87-404a-92fb-f9a357b874c4'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.070083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:09.082081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b95da83876d430796b19575c3c1f879', 'request_id': 'req-708be234-8a87-404a-92fb-f9a357b874c4'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.101953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3645fa1e2d741e3a5b01bd5816bc5e2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.102637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3645fa1e2d741e3a5b01bd5816bc5e2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.103279 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3645fa1e2d741e3a5b01bd5816bc5e2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.109181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] The token cache is being invalidate because project 1b95da83876d430796b19575c3c1f879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:09.109716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.111908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-708be234-8a87-404a-92fb-f9a357b874c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.116420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 976/1962] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:08 2022] DELETE /identity/v3/projects/1b95da83876d430796b19575c3c1f879 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:09.121099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3645fa1e2d741e3a5b01bd5816bc5e2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.123076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.123711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:09.125002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.125443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.133613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8ef32f8f-079f-4974-98d1-fbd735e492d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3645fa1e2d741e3a5b01bd5816bc5e2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.160099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 987/1963] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:08 2022] DELETE /identity/v3/users/e3645fa1e2d741e3a5b01bd5816bc5e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:09.160523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:09.162087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:09.308453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 977/1964] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:09.309917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.310374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.310975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.352504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:09.354015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:09.376943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 988/1965] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:09.378367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.391406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803fd4d-2c82-4771-bc4c-5dbc032ed767 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.398877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.399906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.400400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.400880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.401819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:09.402482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.404604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.424711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 978/1966] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:09.426262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.439486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e48eb3-1b66-4c68-8715-776a37e707f8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.464873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.465078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.465347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.465626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.466337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.468312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.559415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 989/1967] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:09.562448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.575918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be52a44-b76f-4b91-8410-c21fdff816fa admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.723256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.724518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.724694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.725467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.726250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.728811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.760270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 979/1968] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:09.762840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.780895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2efa5-3a64-4d63-a205-e95e4372c832 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.782840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.783488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.783781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.784064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.784815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.786986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.803272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 990/1969] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:09.807709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.820923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafcef2-10da-4c7c-aac7-6c37755795af admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.826697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.827421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.827719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.831758 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.833442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.835403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.836572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.838365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:09.861866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 980/1970] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:09.862228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10795672-abe4-4550-958e-3429635ce07e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.863513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.873343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.874503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.874887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.875439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] PATH_INFO: `/v3/projects/9e6a4e5fdef142839ed83940335d1c1d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.878361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6a4e5fdef142839ed83940335d1c1d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.880792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.889217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0a36e-9dac-4ad1-93d7-05b117878652 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.898206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464303d-7b55-420e-a26c-4fb2c1b94ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.900813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464303d-7b55-420e-a26c-4fb2c1b94ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.901314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464303d-7b55-420e-a26c-4fb2c1b94ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.901776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464303d-7b55-420e-a26c-4fb2c1b94ae2 admin admin] PATH_INFO: `/v3/projects/b2f129d314e347d9af4b24c8d7109b42/users/825a66d8f05d4532944f2c3d72f82bac/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.930173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464303d-7b55-420e-a26c-4fb2c1b94ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f129d314e347d9af4b24c8d7109b42, user_id=825a66d8f05d4532944f2c3d72f82bac, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.934671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464303d-7b55-420e-a26c-4fb2c1b94ae2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.943530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6a4e5fdef142839ed83940335d1c1d', 'request_id': 'req-cd9dc3c5-05fb-4b35-a671-4d57504c831b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.952928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6a4e5fdef142839ed83940335d1c1d', 'request_id': 'req-cd9dc3c5-05fb-4b35-a671-4d57504c831b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.961856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6a4e5fdef142839ed83940335d1c1d', 'request_id': 'req-cd9dc3c5-05fb-4b35-a671-4d57504c831b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.962235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 981/1971] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:09 2022] PUT /identity/v3/projects/b2f129d314e347d9af4b24c8d7109b42/users/825a66d8f05d4532944f2c3d72f82bac/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:09.964356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795c46-8929-4dd9-9909-e10820911591 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.964356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795c46-8929-4dd9-9909-e10820911591 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.964356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795c46-8929-4dd9-9909-e10820911591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.977729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] The token cache is being invalidate because project 9e6a4e5fdef142839ed83940335d1c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:09.978083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.978852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cd9dc3c5-05fb-4b35-a671-4d57504c831b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:09.981294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 991/1972] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:09 2022] DELETE /identity/v3/projects/9e6a4e5fdef142839ed83940335d1c1d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:09.986468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b6186-fed7-45a9-9437-06fca1dfec7b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.986877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b6186-fed7-45a9-9437-06fca1dfec7b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.987258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b6186-fed7-45a9-9437-06fca1dfec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.990626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-62795c46-8929-4dd9-9909-e10820911591 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:09.992802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-62795c46-8929-4dd9-9909-e10820911591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:10.017864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-825b6186-fed7-45a9-9437-06fca1dfec7b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:10.019273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-825b6186-fed7-45a9-9437-06fca1dfec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:10.045331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:10.108706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 982/1973] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:10.120908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62795c46-8929-4dd9-9909-e10820911591 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.123342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-62795c46-8929-4dd9-9909-e10820911591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:10.131772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 992/1974] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:10.140148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.140783 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.141250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.169321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:10.171150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:10.185134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 993/1975] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:10.205379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.219233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89ae28-be3a-49df-9a48-aa652f72a56c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.225655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.226618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.227074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.227366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.228130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:10.228573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.230163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.244801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 994/1976] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:44:10.248485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62795c46-8929-4dd9-9909-e10820911591 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.249498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.250906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.251296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.251679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.252046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.256944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:10.261425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef1a1-0ebd-4304-808b-8607d9b042f5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.262525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.264071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.267091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.267979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.268416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.269018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.270650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.273031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.275656 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 983/1977] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:10.311644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 995/1978] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:10 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:10.312662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.323600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95452-5ff2-40ca-afb7-8f9078abfd20 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.402655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.403620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.403974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.404379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.405219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.407795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.437247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 984/1979] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:10 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:10.441901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.458698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569ac9-e27d-43d7-bc68-b1b6c11d900e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.470283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.470983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.471527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.471861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.472614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.477866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.501645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 996/1980] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:10.503372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.520688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff0c0-afae-42fa-b467-05595a536ba3 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.536980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c8de8-ab2e-4d19-9b00-4617cb112ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.539883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c8de8-ab2e-4d19-9b00-4617cb112ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.540353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c8de8-ab2e-4d19-9b00-4617cb112ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.540741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c8de8-ab2e-4d19-9b00-4617cb112ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.541904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c8de8-ab2e-4d19-9b00-4617cb112ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.544135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c8de8-ab2e-4d19-9b00-4617cb112ae1 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.562453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 985/1981] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:10.564422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.576289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54953a-269f-40ee-9d3a-1221fd3bfcd1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.583047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.584306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.584715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.585057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] PATH_INFO: `/v3/projects/e4653f752b7e46b4b81b3093c8fa925e/users/926e3fa6b2ac4e5e91a6ad0be84ab220/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.611276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4653f752b7e46b4b81b3093c8fa925e, user_id=926e3fa6b2ac4e5e91a6ad0be84ab220, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.616338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:10.636555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 997/1982] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:10 2022] PUT /identity/v3/projects/e4653f752b7e46b4b81b3093c8fa925e/users/926e3fa6b2ac4e5e91a6ad0be84ab220/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:10.650318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.650604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.650883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.693804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] MFA Rules not processed for user `926e3fa6b2ac4e5e91a6ad0be84ab220`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:10.697231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:10.751250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:10.817650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 986/1983] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:10.825700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:10.955913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc795-189e-4d8c-a1a3-910d70e7ff47 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:10.963825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:10.964804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:10.965488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:10.966193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:10.967189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:10.969569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.015817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 998/1984] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:10 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:11.020557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.036258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914422f-d4e3-4e6e-b125-ccedba31f210 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.120891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:11.121891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.122021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.122396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.123215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:11.125450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.169722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 987/1985] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:11 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:11.173640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.185804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d91e43-97a3-48cb-81e4-cb2cb849459c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.191173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:11.191902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.192244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.192528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.193682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:11.195543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.208277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 999/1986] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:11.212756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.225700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f04a5-3cce-40e2-a7c6-411f42641566 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.233150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:11.233998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.234253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.234543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] PATH_INFO: `/v3/projects/76efd99f37684dca8ec8d772fc59ed9c/users/d71c60e8afbc440988b457feba23058e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.252380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76efd99f37684dca8ec8d772fc59ed9c, user_id=d71c60e8afbc440988b457feba23058e, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:11.255125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.284224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 988/1987] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:11 2022] PUT /identity/v3/projects/76efd99f37684dca8ec8d772fc59ed9c/users/d71c60e8afbc440988b457feba23058e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:11.289197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.310115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7755d5-97ad-402d-b271-e18e9ae2c996 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.415416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79a632-66e4-44e9-b209-7198d82ae623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:11.416102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79a632-66e4-44e9-b209-7198d82ae623 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.416390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79a632-66e4-44e9-b209-7198d82ae623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.416670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79a632-66e4-44e9-b209-7198d82ae623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.417410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79a632-66e4-44e9-b209-7198d82ae623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:11.419585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79a632-66e4-44e9-b209-7198d82ae623 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.435005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1000/1988] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:11.441874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.468543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88cec-204d-4966-a0f4-8b7ff2e7eb65 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.488283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54dd32-4e33-4892-adaa-356e4f7ce76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:11.489818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dd32-4e33-4892-adaa-356e4f7ce76f admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.490353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dd32-4e33-4892-adaa-356e4f7ce76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.490817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dd32-4e33-4892-adaa-356e4f7ce76f admin admin] PATH_INFO: `/v3/projects/76efd99f37684dca8ec8d772fc59ed9c/users/d71c60e8afbc440988b457feba23058e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.493833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dd32-4e33-4892-adaa-356e4f7ce76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76efd99f37684dca8ec8d772fc59ed9c, user_id=d71c60e8afbc440988b457feba23058e, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:11.497365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dd32-4e33-4892-adaa-356e4f7ce76f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.512767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 989/1989] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:11 2022] PUT /identity/v3/projects/76efd99f37684dca8ec8d772fc59ed9c/users/d71c60e8afbc440988b457feba23058e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:11.522968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.523281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.523621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.591925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] MFA Rules not processed for user `d71c60e8afbc440988b457feba23058e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:11.594745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:11.606910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:11.672096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.673004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.673296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.734708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] MFA Rules not processed for user `825a66d8f05d4532944f2c3d72f82bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:11.736363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:11.772352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1001/1990] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:11.788112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.793197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:11.876154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 990/1991] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:11.881244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.884431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:11.899363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782986f8-f7ab-422d-bf7a-bcc650288f60 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.903568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:11.904442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.904728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.905160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.920856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:11.922485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:11.943193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1002/1992] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:11.951742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:12.084176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51192-7624-4eff-ab97-0445b2f35f7a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.106856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.108521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.111930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.113061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.115871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.119884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.175796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 991/1993] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:11 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:12.180349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.195831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5508-53f7-4090-be17-e3cc329343d2 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.342634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.343891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.343891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.344197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.345024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.347430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.389955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1003/1994] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:12 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:12.396931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.413053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822cba-fe76-4fb8-b45c-8c1a61a065a1 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.425528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.427459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.427967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.428674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.431065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.434251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.452090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 992/1995] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:12.456853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.482621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37cc75-f1a1-4225-a0d7-6276742d0a75 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.495851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.497246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:12.499356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.500365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.500744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.500920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] PATH_INFO: `/v3/projects/508d92d2e99f47d493fcb3cc886dcc1a/users/cd0510b7d2ef4dce94104e1fbf5191bf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.519502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae7b3-7fa3-4ecb-85d0-40972fc3a5b8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.528503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d92d2e99f47d493fcb3cc886dcc1a, user_id=cd0510b7d2ef4dce94104e1fbf5191bf, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.531596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.539590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.540793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.541071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.541521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] PATH_INFO: `/v3/users/0f295b9f895a4f6fa775d031a378db90` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.544397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f295b9f895a4f6fa775d031a378db90)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.553974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1004/1996] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:12 2022] PUT /identity/v3/projects/508d92d2e99f47d493fcb3cc886dcc1a/users/cd0510b7d2ef4dce94104e1fbf5191bf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:12.558724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.558841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.578618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:12.646620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f295b9f895a4f6fa775d031a378db90'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:12.647533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f295b9f895a4f6fa775d031a378db90'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:12.648778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f295b9f895a4f6fa775d031a378db90'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:12.665370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f295b9f895a4f6fa775d031a378db90'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:12.666194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cac619-c1b9-4898-9e7b-e4747b80d1af admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.670997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.671708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.671991 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.672266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.672998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.674599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.675097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-952de865-25d4-4a0b-94e4-c87b0dffef8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f295b9f895a4f6fa775d031a378db90'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:12.686124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1005/1997] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:12.690390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.692715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:12.701298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 993/1998] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:12 2022] DELETE /identity/v3/users/0f295b9f895a4f6fa775d031a378db90 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:12.709869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.710239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.710557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.716273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f7a04-4d90-4786-8ff8-73c6af11b584 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.739713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:12.741285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:12.813740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.813740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.813740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.814020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] PATH_INFO: `/v3/projects/508d92d2e99f47d493fcb3cc886dcc1a/users/cd0510b7d2ef4dce94104e1fbf5191bf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.816780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d92d2e99f47d493fcb3cc886dcc1a, user_id=cd0510b7d2ef4dce94104e1fbf5191bf, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.821337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.841548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1006/1999] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:12 2022] PUT /identity/v3/projects/508d92d2e99f47d493fcb3cc886dcc1a/users/cd0510b7d2ef4dce94104e1fbf5191bf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:12.842861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.843837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 994/2000] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:12.845955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:12.872340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:12.875001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:12.890115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:12.939116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657572a-8eef-4090-a8a2-62ecc4d429f2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:12.946415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.947376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.947692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.947973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] PATH_INFO: `/v3/users/926e3fa6b2ac4e5e91a6ad0be84ab220` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.949384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=926e3fa6b2ac4e5e91a6ad0be84ab220)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.951339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.952069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fdb6f-9636-4f3a-975b-3ac5d4b05d06 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:13.021736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:13.024647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aa261-8a60-441e-892c-3d5b3d2c9af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:13.025555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa261-8a60-441e-892c-3d5b3d2c9af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:13.026448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa261-8a60-441e-892c-3d5b3d2c9af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:13.027074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa261-8a60-441e-892c-3d5b3d2c9af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:13.029377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926e3fa6b2ac4e5e91a6ad0be84ab220'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:13.030944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926e3fa6b2ac4e5e91a6ad0be84ab220'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:13.031714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926e3fa6b2ac4e5e91a6ad0be84ab220'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:13.039057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aa261-8a60-441e-892c-3d5b3d2c9af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:13.040855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aa261-8a60-441e-892c-3d5b3d2c9af9 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:13.052151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926e3fa6b2ac4e5e91a6ad0be84ab220'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:13.055117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 995/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:13.064824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926e3fa6b2ac4e5e91a6ad0be84ab220'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:13.078956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1007/2002] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:12 2022] DELETE /identity/v3/users/926e3fa6b2ac4e5e91a6ad0be84ab220 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:13.084592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:13.086733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:13.087426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:13.113888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:13.115181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:13.190302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 996/2003] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:13.199352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:13.201224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:13.278698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efaa1d-de53-4eb6-bda6-cb745e9890ac admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:13.282524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:13.283275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:13.283656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:13.284008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:13.294595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:13.299133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:13.319512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1008/2004] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:13.860865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:13.863912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:13.884778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d391e4-c1e3-49d0-9762-a0f219f674ad None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:13.892114 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:13.893391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:13.893391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:13.893901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] PATH_INFO: `/v3/projects/e4653f752b7e46b4b81b3093c8fa925e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:13.896034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4653f752b7e46b4b81b3093c8fa925e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:13.899240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:13.997218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4653f752b7e46b4b81b3093c8fa925e', 'request_id': 'req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.011899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4653f752b7e46b4b81b3093c8fa925e', 'request_id': 'req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.017858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:14.021654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4653f752b7e46b4b81b3093c8fa925e', 'request_id': 'req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.039274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] The token cache is being invalidate because project e4653f752b7e46b4b81b3093c8fa925e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:14.039597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.040331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-7d7d329d-fb78-4faa-a3e4-21c3afa98dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.042070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 997/2005] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:13 2022] DELETE /identity/v3/projects/e4653f752b7e46b4b81b3093c8fa925e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:14.045804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:14.060471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34088-87d8-4b33-b9bc-11ff4d015b5a service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:14.145748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:14.146853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:14.147722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:14.147842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] PATH_INFO: `/v3/users/d71c60e8afbc440988b457feba23058e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:14.149770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71c60e8afbc440988b457feba23058e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:14.152080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:14.177254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677448ab-abee-4a14-90c6-e24048534760 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:14.177773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677448ab-abee-4a14-90c6-e24048534760 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:14.177941 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677448ab-abee-4a14-90c6-e24048534760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:14.214086 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71c60e8afbc440988b457feba23058e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.215009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71c60e8afbc440988b457feba23058e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.216444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71c60e8afbc440988b457feba23058e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.216934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-677448ab-abee-4a14-90c6-e24048534760 None None] MFA Rules not processed for user `cd0510b7d2ef4dce94104e1fbf5191bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:14.218293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-677448ab-abee-4a14-90c6-e24048534760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.233286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71c60e8afbc440988b457feba23058e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.235190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:14.251014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-82bfdb20-4a4f-4a8b-9c8e-b9b6cc730c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71c60e8afbc440988b457feba23058e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.272090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1009/2006] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:14 2022] DELETE /identity/v3/users/d71c60e8afbc440988b457feba23058e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:14.335557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 998/2007] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:14.343969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:14.344265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:14.344624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:14.367637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] MFA Rules not processed for user `825a66d8f05d4532944f2c3d72f82bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:14.369309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.466872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1010/2008] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:14.479183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677448ab-abee-4a14-90c6-e24048534760 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:14.480440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-677448ab-abee-4a14-90c6-e24048534760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.512140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:14.514484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.613755 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70014816-cf95-45df-99ba-fb61f8939477 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:14.615756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677448ab-abee-4a14-90c6-e24048534760 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:14.622287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:14.623835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:14.624123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:14.624404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] PATH_INFO: `/v3/projects/f1e4d092c44e4f06821b039f79aaf866` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:14.633490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e4d092c44e4f06821b039f79aaf866)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:14.642954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:14.695461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:14.696143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:14.696430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:14.696709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:14.699895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.715095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:14.716787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:14.721591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:14.730924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 999/2009] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:14.756910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:14.762397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.806567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200da6-5ee4-4ee6-a38c-fbd51c54dddd service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:14.862167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e4d092c44e4f06821b039f79aaf866', 'request_id': 'req-b86c4240-2957-4108-914a-37531825a7dc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.885709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e4d092c44e4f06821b039f79aaf866', 'request_id': 'req-b86c4240-2957-4108-914a-37531825a7dc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.893461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e4d092c44e4f06821b039f79aaf866', 'request_id': 'req-b86c4240-2957-4108-914a-37531825a7dc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.912023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] The token cache is being invalidate because project f1e4d092c44e4f06821b039f79aaf866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:14.912420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.914320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:14.927638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1011/2010] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:14 2022] DELETE /identity/v3/projects/f1e4d092c44e4f06821b039f79aaf866 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:14.931751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:14.933582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:14.964324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:14.999008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.000195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.000723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.001032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] PATH_INFO: `/v3/projects/76efd99f37684dca8ec8d772fc59ed9c` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.002559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76efd99f37684dca8ec8d772fc59ed9c)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.006646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.024731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4240-2957-4108-914a-37531825a7dc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.034243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.035776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.036219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.039907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] PATH_INFO: `/v3/users/58f9ad88ee4144b6be5b75e2538ced73` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.042182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f9ad88ee4144b6be5b75e2538ced73)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.044256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.133460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76efd99f37684dca8ec8d772fc59ed9c', 'request_id': 'req-0998e295-f915-4842-8b86-78a74d9e0f8e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.154530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76efd99f37684dca8ec8d772fc59ed9c', 'request_id': 'req-0998e295-f915-4842-8b86-78a74d9e0f8e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.162212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f9ad88ee4144b6be5b75e2538ced73'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.162930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f9ad88ee4144b6be5b75e2538ced73'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.164191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f9ad88ee4144b6be5b75e2538ced73'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.173955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76efd99f37684dca8ec8d772fc59ed9c', 'request_id': 'req-0998e295-f915-4842-8b86-78a74d9e0f8e'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.180361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f9ad88ee4144b6be5b75e2538ced73'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.190197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-85e405e4-6f68-411b-ad73-b6704ac8a029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f9ad88ee4144b6be5b75e2538ced73'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.207727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] The token cache is being invalidate because project 76efd99f37684dca8ec8d772fc59ed9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:15.208245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.208787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0998e295-f915-4842-8b86-78a74d9e0f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.209964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1012/2011] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:14 2022] DELETE /identity/v3/users/58f9ad88ee4144b6be5b75e2538ced73 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:15.214405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1000/2012] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:14 2022] DELETE /identity/v3/projects/76efd99f37684dca8ec8d772fc59ed9c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:15.222873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.223741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.223741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.269666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:15.271957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:15.365814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1013/2013] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:15.374014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.374303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.374583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.398932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:15.400219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:15.416302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1001/2014] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:15.420820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.431960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072ab0-c228-4084-8ec7-3fa656c64270 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.437079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.437811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.438112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.438443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.439379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:15.439875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.441690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.463148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.476321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1014/2015] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:15.481032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5ec2a-9558-4e88-a9f6-1d1062217ec3 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.486376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.487168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.487781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.488161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.488973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.491166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.528476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1002/2016] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:15.532600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.546102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ef82-834c-40b3-8248-8b76b6f329e0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.584074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:15.637023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.637837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.638135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.638413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.639817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.641822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.670185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1015/2017] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:15.678270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.693464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c70c40-7b95-4e56-8303-fdd19c0ab4ec admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.701783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.702587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.702757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.702993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.703782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.706546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.727288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.729255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:15.739003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1003/2018] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:15.744435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.754882 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dbced-3bce-41c9-aaf4-da1fa3448a90 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.765621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ba59-8ad8-4d2e-905b-fc88f813633b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.767270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.768174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.768457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.769717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] PATH_INFO: `/v3/projects/560470a589034458b75481052398d923` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.771538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=560470a589034458b75481052398d923)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.773578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.779689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.780359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.780646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.781439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.782180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.788129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.822779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1004/2019] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:15.826949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:15.838865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a9d96-93f4-4f0b-a346-543728627ba9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:15.854632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560470a589034458b75481052398d923', 'request_id': 'req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.866302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560470a589034458b75481052398d923', 'request_id': 'req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.876553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560470a589034458b75481052398d923', 'request_id': 'req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.885695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:15.898846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] The token cache is being invalidate because project 560470a589034458b75481052398d923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:15.899838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.900593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e4ff14cd-9ffd-4371-b0bf-41f60585a89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:15.907498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1016/2020] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:15 2022] DELETE /identity/v3/projects/560470a589034458b75481052398d923 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:15.910591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec36e-6460-471f-924f-b4cdd0c56ec2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.910981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec36e-6460-471f-924f-b4cdd0c56ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.911366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec36e-6460-471f-924f-b4cdd0c56ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.920887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dcd00-9d0a-4e60-a627-1251c2157e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:15.922738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dcd00-9d0a-4e60-a627-1251c2157e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.923032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dcd00-9d0a-4e60-a627-1251c2157e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.923315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dcd00-9d0a-4e60-a627-1251c2157e1f admin admin] PATH_INFO: `/v3/projects/05eca0755ef6445d8afc38e119e84c08/users/c3a54da9dcf0412bb2eee3f86650263d/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.936753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4edec36e-6460-471f-924f-b4cdd0c56ec2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:15.938428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4edec36e-6460-471f-924f-b4cdd0c56ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:15.948112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dcd00-9d0a-4e60-a627-1251c2157e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eca0755ef6445d8afc38e119e84c08, user_id=c3a54da9dcf0412bb2eee3f86650263d, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:15.951522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dcd00-9d0a-4e60-a627-1251c2157e1f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:15.951679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1017/2021] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:15.961712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.962287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.962639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.984573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1005/2022] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:15 2022] PUT /identity/v3/projects/05eca0755ef6445d8afc38e119e84c08/users/c3a54da9dcf0412bb2eee3f86650263d/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:15.992924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:15.993434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:15.993989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:15.996524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:15.997896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:16.033212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] MFA Rules not processed for user `c3a54da9dcf0412bb2eee3f86650263d`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:16.035414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:16.076652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1018/2023] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:16.081043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.092701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cc484-88fe-4e80-873d-c5326dbcbf47 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.098719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.099551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.100184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.100537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.101994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:16.102531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.105567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.114096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1006/2024] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:16.123173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1019/2025] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:16.127884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.129484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.131420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:16.141457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781671-25dc-4e49-a155-4bad91230567 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.147116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.148021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.148315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.148914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.149629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.151599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.171210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:16.189928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1007/2026] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:16 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:16.195093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.275544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eb351-1e73-401e-aa67-4de8a91c9895 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.295596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72eb0c-cc7e-48e8-954d-655ee8929e47 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.301640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.301640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.301640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.301640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.302752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.305964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.343428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1008/2027] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:16 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:16.356311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.361525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026992e0-888d-4bcb-90a2-2961e9daef2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.362291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026992e0-888d-4bcb-90a2-2961e9daef2b service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.362676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026992e0-888d-4bcb-90a2-2961e9daef2b service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.363054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026992e0-888d-4bcb-90a2-2961e9daef2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.372912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c40e5-0af0-4d71-903a-2c0427ec92be admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.378388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.383561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.384072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.384566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.385665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.388014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.408975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1009/2028] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:16.410246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.424485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457cb5-c6f6-4950-92c4-5d5faa313c8a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.429503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.430423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.430681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.431053 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.431931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.434157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.435799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:16.454631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1010/2029] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:16.455551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.465708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026992e0-888d-4bcb-90a2-2961e9daef2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.467434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711cb87-5c43-4f58-8e5b-8f4bb8cb5221 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.468322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026992e0-888d-4bcb-90a2-2961e9daef2b service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.472999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.475827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.475827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.475827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] PATH_INFO: `/v3/projects/891ae9e95a704b92a7525cc706cb5095/users/cb28d8ccee034bf2899f9a7219a3050b/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.492304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1020/2030] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:16.502503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] RBAC: Authorizing `identity:create_grant(project_id=891ae9e95a704b92a7525cc706cb5095, user_id=cb28d8ccee034bf2899f9a7219a3050b, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.506605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.520312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1011/2031] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:16 2022] PUT /identity/v3/projects/891ae9e95a704b92a7525cc706cb5095/users/cb28d8ccee034bf2899f9a7219a3050b/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:16.531939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.532240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.532524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.569760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] MFA Rules not processed for user `cb28d8ccee034bf2899f9a7219a3050b`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:16.571014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:16.648936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:16.658517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1021/2032] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:16.662972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.741275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7bb8a-b080-4fed-98f6-316d27ea560f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.749728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.750565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.750949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.751333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.752495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.754543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.810450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1012/2033] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:16 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:16.812470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.828634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8dd7e-6315-4f6c-b08e-f9a2f4793a91 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:16.928038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:16.928773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:16.929068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:16.930014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:16.930773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:16.940690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:16.981082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1022/2034] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:16 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:16.985397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:16.997070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1323aa-a06b-4ec6-9432-aaa41c495060 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:17.004604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:17.006020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.006855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.007157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.008914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:17.010263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:17.029254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1013/2035] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:17.033721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:17.048387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768611e-e085-4e00-8cdb-c21f4befe03e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:17.056312 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:17.056879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.057488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.057890 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] PATH_INFO: `/v3/projects/9441ada2fb1f4a128fd4f6bc597d1569/users/cb107f5bc4224b55aa6daf4ce4b6b117/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.081168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9441ada2fb1f4a128fd4f6bc597d1569, user_id=cb107f5bc4224b55aa6daf4ce4b6b117, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:17.084914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:17.129722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:17.130789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1023/2036] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:17 2022] PUT /identity/v3/projects/9441ada2fb1f4a128fd4f6bc597d1569/users/cb107f5bc4224b55aa6daf4ce4b6b117/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:17.145249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9f0b8-e110-469c-8d9a-599f410053fb admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:17.228777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498a24-8b19-4097-a6ab-dac88e8dd855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:17.229853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498a24-8b19-4097-a6ab-dac88e8dd855 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.230255 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498a24-8b19-4097-a6ab-dac88e8dd855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.230756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498a24-8b19-4097-a6ab-dac88e8dd855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.231840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c498a24-8b19-4097-a6ab-dac88e8dd855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:17.233711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c498a24-8b19-4097-a6ab-dac88e8dd855 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:17.247178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1014/2037] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:17.251505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:17.262742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fbda-1381-4a54-a4ce-47048ab0b6d0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:17.269531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:17.270944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.271575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.272005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] PATH_INFO: `/v3/projects/9441ada2fb1f4a128fd4f6bc597d1569/users/cb107f5bc4224b55aa6daf4ce4b6b117/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.275238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9441ada2fb1f4a128fd4f6bc597d1569, user_id=cb107f5bc4224b55aa6daf4ce4b6b117, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:17.278034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:17.290016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1024/2038] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:17 2022] PUT /identity/v3/projects/9441ada2fb1f4a128fd4f6bc597d1569/users/cb107f5bc4224b55aa6daf4ce4b6b117/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:17.301067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.302800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.303096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.333945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] MFA Rules not processed for user `cb107f5bc4224b55aa6daf4ce4b6b117`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:17.335209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:17.384041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:17.437753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1015/2039] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:17.454565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:17.457556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:17.556732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275adf74-2489-4ffa-9799-6b151bf57190 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:17.560505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:17.561250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.561601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.561946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.571836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:17.573343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:17.583219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1025/2040] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:17.640556 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:17.642252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:17.662247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09f7b9-93b6-4610-9e7e-5199429d2025 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:17.667936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55784e-d3d6-4873-87fe-52dc3ea62dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:17.668548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55784e-d3d6-4873-87fe-52dc3ea62dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:17.668899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55784e-d3d6-4873-87fe-52dc3ea62dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:17.669230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55784e-d3d6-4873-87fe-52dc3ea62dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:17.735496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55784e-d3d6-4873-87fe-52dc3ea62dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:17.740308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55784e-d3d6-4873-87fe-52dc3ea62dc1 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:17.752831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1016/2041] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:19.585120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:19.586567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:19.702232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:19.720548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a2c29-ca8f-487d-ad9c-bb399c5daefa service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:19.725754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:19.726684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:19.726971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:19.727252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] PATH_INFO: `/v3/users/9c893d5f5628473da5f3be1d586503a4` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:19.728538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c893d5f5628473da5f3be1d586503a4)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:19.730708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:19.798211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c893d5f5628473da5f3be1d586503a4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:19.799327 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c893d5f5628473da5f3be1d586503a4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:19.800361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c893d5f5628473da5f3be1d586503a4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:19.821338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c893d5f5628473da5f3be1d586503a4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:19.831999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c893d5f5628473da5f3be1d586503a4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:19.848815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1026/2042] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:19 2022] DELETE /identity/v3/users/9c893d5f5628473da5f3be1d586503a4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:19.854253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:19.855015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:19.855377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:19.876699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:19.877968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:19.984515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1017/2043] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:19.991411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:19.993008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:20.091272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b527264-beff-40e6-898f-ad00bb563fd9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:20.100268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd33933-2a1c-4e47-b269-b43eb1be0c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:20.102185 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd33933-2a1c-4e47-b269-b43eb1be0c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:20.102812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd33933-2a1c-4e47-b269-b43eb1be0c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:20.103303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd33933-2a1c-4e47-b269-b43eb1be0c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:20.116322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd33933-2a1c-4e47-b269-b43eb1be0c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:20.118983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd33933-2a1c-4e47-b269-b43eb1be0c05 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:20.133151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1027/2044] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:20.624273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:20.626209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:20.656603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471355d-2270-4066-a55c-a6aef9f34b02 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:20.661411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:20.662286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:20.662571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:20.663416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] PATH_INFO: `/v3/projects/4403d93d21a04f7e95face079d11b64c` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:20.664670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4403d93d21a04f7e95face079d11b64c)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:20.666570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:20.739628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4403d93d21a04f7e95face079d11b64c', 'request_id': 'req-24e41ada-7313-4dd5-8bdd-d19ca2227019'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:20.758917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4403d93d21a04f7e95face079d11b64c', 'request_id': 'req-24e41ada-7313-4dd5-8bdd-d19ca2227019'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:20.763134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:20.765325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4403d93d21a04f7e95face079d11b64c', 'request_id': 'req-24e41ada-7313-4dd5-8bdd-d19ca2227019'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:20.782470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] The token cache is being invalidate because project 4403d93d21a04f7e95face079d11b64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:20.782820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:20.783655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-24e41ada-7313-4dd5-8bdd-d19ca2227019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:20.785304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1018/2045] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:20 2022] DELETE /identity/v3/projects/4403d93d21a04f7e95face079d11b64c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:20.790513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:20.791002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:20.791102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:20.815856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:20.817081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:20.884038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1028/2046] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:20.896716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:20.897254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:20.897431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:20.919537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:20.920787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:20.929664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1019/2047] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:20.933740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:20.943747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003e05-40b0-4e3a-a8b9-ee797c31c8e5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:20.952627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:20.953637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:20.953958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:20.954329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:20.955602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:20.956004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:20.957985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:20.971682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1029/2048] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:20.976322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:20.990318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e6a4-9152-47c6-8d5f-aa5eca14fa3b None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:20.995698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:20.996445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:20.996654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:20.996933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:20.997640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:20.999574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:21.041326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1020/2049] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:20 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:21.051812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:21.058806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:21.067066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1648e-ed1c-4f12-bd18-98690760ef5f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:21.172108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:21.172803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:21.173089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:21.173368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:21.174295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:21.176308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:21.218130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1030/2050] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:21 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:21.236940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:21.250883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21d2c-2dfd-4e62-8bc5-1239a475e865 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:21.278956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:21.280798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:21.283774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:21.284248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:21.286321 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:21.294885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:21.322953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:21.326479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1021/2051] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:21.343087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2a70-5243-41c0-9991-e0886fa04e32 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:21.353027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759628f3-a0fd-4295-ba3f-5ae5ebfe88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:21.353905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759628f3-a0fd-4295-ba3f-5ae5ebfe88ef admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:21.354406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759628f3-a0fd-4295-ba3f-5ae5ebfe88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:21.354720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759628f3-a0fd-4295-ba3f-5ae5ebfe88ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:21.355634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759628f3-a0fd-4295-ba3f-5ae5ebfe88ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:21.357688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759628f3-a0fd-4295-ba3f-5ae5ebfe88ef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:21.375564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1031/2052] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:21.379877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:21.399853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaba7f-517a-41a3-835f-9c25c0456764 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:21.407291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:21.408714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:21.409165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:21.410162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] PATH_INFO: `/v3/projects/8d326f182e26442fbea27310fa2ca4ab/users/4e52d439bf1e483a82fad41cd8ae3f0b/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:21.439814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d326f182e26442fbea27310fa2ca4ab, user_id=4e52d439bf1e483a82fad41cd8ae3f0b, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:21.443557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:21.477887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1022/2053] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:21 2022] PUT /identity/v3/projects/8d326f182e26442fbea27310fa2ca4ab/users/4e52d439bf1e483a82fad41cd8ae3f0b/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:21.487935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:21.488519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:21.489022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:21.536048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] MFA Rules not processed for user `4e52d439bf1e483a82fad41cd8ae3f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:21.537927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:21.704286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1032/2054] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:21.712273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:21.714266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:21.848221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56305be2-ac71-4a6d-b6e5-e0b6e19844e3 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:21.852934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6e688-6f9e-4809-858c-486b8abae75b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:21.856805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6e688-6f9e-4809-858c-486b8abae75b service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:21.857179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6e688-6f9e-4809-858c-486b8abae75b service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:21.857537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6e688-6f9e-4809-858c-486b8abae75b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:21.871766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6e688-6f9e-4809-858c-486b8abae75b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:21.873287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6e688-6f9e-4809-858c-486b8abae75b service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:21.882773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1023/2055] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:21.952827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:21.954870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:22.043995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8e23-f4a6-4a88-9c15-391edb1a3ed2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:22.053199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:22.054116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:22.054414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:22.054747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] PATH_INFO: `/v3/users/cb28d8ccee034bf2899f9a7219a3050b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:22.056662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb28d8ccee034bf2899f9a7219a3050b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:22.059219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:22.084691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:22.190620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb28d8ccee034bf2899f9a7219a3050b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.191577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb28d8ccee034bf2899f9a7219a3050b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.192575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb28d8ccee034bf2899f9a7219a3050b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.219443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb28d8ccee034bf2899f9a7219a3050b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.230874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb28d8ccee034bf2899f9a7219a3050b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.272160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1033/2056] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:21 2022] DELETE /identity/v3/users/cb28d8ccee034bf2899f9a7219a3050b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:22.273325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:22.273325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:22.273325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:22.297508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:22.299412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:22.447469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1024/2057] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:22.461277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:22.463362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:22.594425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fecb0-3aa2-4281-85e8-596c7aca29de admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:22.603903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:22.604604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:22.605207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:22.605512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:22.616326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:22.618483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:22.632735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1034/2058] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:22.834084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:22.835939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:22.851429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef37f86-a0ac-418d-bc9e-28e59f6d63ad None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:22.857264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:22.858236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:22.858590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:22.858935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] PATH_INFO: `/v3/users/fb1e3c767d0e4d8c810376176384d99d` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:22.860250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1e3c767d0e4d8c810376176384d99d)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:22.862246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:22.888911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:22.920137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1e3c767d0e4d8c810376176384d99d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.920729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1e3c767d0e4d8c810376176384d99d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.921342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1e3c767d0e4d8c810376176384d99d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.935112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1e3c767d0e4d8c810376176384d99d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.948178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1e3c767d0e4d8c810376176384d99d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:22.966649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1025/2059] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:22 2022] DELETE /identity/v3/users/fb1e3c767d0e4d8c810376176384d99d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:23.021417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.023636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:23.039980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29088-6955-46c8-ac74-3dfb6d6e5ba6 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.108022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.109306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.109661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.110010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] PATH_INFO: `/v3/projects/891ae9e95a704b92a7525cc706cb5095` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.111709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=891ae9e95a704b92a7525cc706cb5095)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:23.113863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:23.155011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:23.167962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891ae9e95a704b92a7525cc706cb5095', 'request_id': 'req-aa305f33-5f85-4a9b-b946-2503093a0daa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.180363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.181226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891ae9e95a704b92a7525cc706cb5095', 'request_id': 'req-aa305f33-5f85-4a9b-b946-2503093a0daa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.181942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:23.188169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891ae9e95a704b92a7525cc706cb5095', 'request_id': 'req-aa305f33-5f85-4a9b-b946-2503093a0daa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.196465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c2f4-201f-4640-b9d9-753303cc876d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.202939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] The token cache is being invalidate because project 891ae9e95a704b92a7525cc706cb5095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:23.203629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.204292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.205886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1035/2060] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:23 2022] DELETE /identity/v3/projects/891ae9e95a704b92a7525cc706cb5095 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:23.212593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.214222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:23.267904 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.268947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.269336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.269767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] PATH_INFO: `/v3/projects/37d6981c7d124e49966fa4c5fa49ed04` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.271037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d6981c7d124e49966fa4c5fa49ed04)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:23.273643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:23.297543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305f33-5f85-4a9b-b946-2503093a0daa admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.302470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.303590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.304104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.304633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] PATH_INFO: `/v3/users/cb107f5bc4224b55aa6daf4ce4b6b117` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.305852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb107f5bc4224b55aa6daf4ce4b6b117)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:23.307890 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:23.334537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d6981c7d124e49966fa4c5fa49ed04', 'request_id': 'req-2a816461-5a27-4b43-8eef-dc83910558b9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.345785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d6981c7d124e49966fa4c5fa49ed04', 'request_id': 'req-2a816461-5a27-4b43-8eef-dc83910558b9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.359161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d6981c7d124e49966fa4c5fa49ed04', 'request_id': 'req-2a816461-5a27-4b43-8eef-dc83910558b9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.376051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] The token cache is being invalidate because project 37d6981c7d124e49966fa4c5fa49ed04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:23.376322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.377634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a816461-5a27-4b43-8eef-dc83910558b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.377953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb107f5bc4224b55aa6daf4ce4b6b117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.378736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb107f5bc4224b55aa6daf4ce4b6b117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.379371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb107f5bc4224b55aa6daf4ce4b6b117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.380577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1026/2061] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:23 2022] DELETE /identity/v3/projects/37d6981c7d124e49966fa4c5fa49ed04 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:23.386859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.388976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.389262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.400215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb107f5bc4224b55aa6daf4ce4b6b117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.412531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:23.415130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:23.420519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dad289f-6911-4b39-93df-465a4822faf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb107f5bc4224b55aa6daf4ce4b6b117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:23.443989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1036/2062] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:23 2022] DELETE /identity/v3/users/cb107f5bc4224b55aa6daf4ce4b6b117 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:23.470956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:23.522552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1027/2063] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:23.531808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.532318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.532803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.556804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:23.558164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:23.636908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:23.672354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1037/2064] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:23.676779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.711693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163cf3-f8c6-4bb6-a2db-04d8d7f12100 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.725266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.726824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.727293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.727812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.728844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:23.729326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:23.733046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:23.759809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1028/2065] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:23.760292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.773898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea9f6b-d9cc-449f-bf25-c255c9d6177c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.790158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.790830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.791315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.791743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.792507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:23.794604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:23.824156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1038/2066] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:23 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:23.828268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.840765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1320d3-7f57-45d3-8ca3-70d9b3a50c24 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.888927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.891323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:23.916157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.917722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.918181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.918607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:23.921394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:23.924612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:23.969766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1029/2067] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:23 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:23.975316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:23.989101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8e342-b810-44e6-899e-5e12b78135d8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:23.996583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:23.998961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:23.998961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:23.999233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.000130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.002136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.003560 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6356a5-d1b1-4e3f-98dc-0eebeb983767 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.012930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.014629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.015095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.016020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] PATH_INFO: `/v3/projects/9441ada2fb1f4a128fd4f6bc597d1569` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.018655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1030/2068] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:24.019642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.020342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9441ada2fb1f4a128fd4f6bc597d1569)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.023302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.042493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a0e98-c133-4e70-9185-d2127998bc5a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.048583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.049256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.049537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.049811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.050541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.052178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.064151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1031/2069] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:24.068255 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.078401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5a279-5607-4fb5-ad74-005cc361321c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.080097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9441ada2fb1f4a128fd4f6bc597d1569', 'request_id': 'req-e8190aa1-a4bd-4f02-878c-7e0017d38f90'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:24.088444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9441ada2fb1f4a128fd4f6bc597d1569', 'request_id': 'req-e8190aa1-a4bd-4f02-878c-7e0017d38f90'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:24.094534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9441ada2fb1f4a128fd4f6bc597d1569', 'request_id': 'req-e8190aa1-a4bd-4f02-878c-7e0017d38f90'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:24.107892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] The token cache is being invalidate because project 9441ada2fb1f4a128fd4f6bc597d1569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:24.108205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:24.108869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8190aa1-a4bd-4f02-878c-7e0017d38f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:24.110462 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1039/2070] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:23 2022] DELETE /identity/v3/projects/9441ada2fb1f4a128fd4f6bc597d1569 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:24.115084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644897-3b38-4bc3-b893-e01fa684c923 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.115399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644897-3b38-4bc3-b893-e01fa684c923 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.115677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644897-3b38-4bc3-b893-e01fa684c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.136451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1d644897-3b38-4bc3-b893-e01fa684c923 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:24.137594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1d644897-3b38-4bc3-b893-e01fa684c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:24.138051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98a4be-01fd-41b3-a8e0-9390480e5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.138954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a4be-01fd-41b3-a8e0-9390480e5597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.139218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a4be-01fd-41b3-a8e0-9390480e5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.139542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a4be-01fd-41b3-a8e0-9390480e5597 admin admin] PATH_INFO: `/v3/projects/bfab560d0589400585f4c1b2587a811e/users/d2fda32283284da3870e98a18e281da1/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.145765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1040/2071] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:24.153384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.153673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.153952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.155135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98a4be-01fd-41b3-a8e0-9390480e5597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfab560d0589400585f4c1b2587a811e, user_id=d2fda32283284da3870e98a18e281da1, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.158071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98a4be-01fd-41b3-a8e0-9390480e5597 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.172204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1032/2072] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:24 2022] PUT /identity/v3/projects/bfab560d0589400585f4c1b2587a811e/users/d2fda32283284da3870e98a18e281da1/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:24.173732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:24.174958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:24.182796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.183085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.183363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.203356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:24.214169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] MFA Rules not processed for user `d2fda32283284da3870e98a18e281da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:24.215832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:24.220439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:24.241919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1041/2073] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:24.246547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.255454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0cd5-8572-4d44-9124-6c6570f01324 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.260895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.261544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.261824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.262099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.262933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:24.263242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.264993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.279576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1042/2074] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:44:24.282966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.285273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1033/2075] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:24.297098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.298151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac559-0d72-4b78-8e37-0d071458cfda admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.298511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:24.302904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.303620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.304600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.304883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.305591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.307544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.340370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1043/2076] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:24.344274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.377761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980f40-4174-4151-9e9d-b3e3e97e7b85 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.411353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8fc1a-acb6-48f4-92b6-c3c02b2e8fbf admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.416654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.417326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.417611 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.417885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.418578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.420549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.442840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1044/2077] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:24.445949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31458c1e-b8c5-4d6a-bf0a-be11298f3844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.446644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458c1e-b8c5-4d6a-bf0a-be11298f3844 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.446929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458c1e-b8c5-4d6a-bf0a-be11298f3844 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.447040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.447269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458c1e-b8c5-4d6a-bf0a-be11298f3844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.457219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfb3f-d222-438f-bf6f-7959925e469f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.462280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.462959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.463319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.463693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.464431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.466062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.481202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1045/2078] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:24.482386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.486313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:24.493578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbbb18-c33e-4f05-b117-c0c1edcaeb2b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.498174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.498835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.499114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.499442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.500174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.501760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.515111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458c1e-b8c5-4d6a-bf0a-be11298f3844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.515766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1046/2079] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:24.519527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.519916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458c1e-b8c5-4d6a-bf0a-be11298f3844 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.529673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a640d-b6e0-4990-b024-3593e25f2d4b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.533275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1034/2080] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:24.534431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.535326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.535640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.535917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] PATH_INFO: `/v3/projects/06b971250d5a435db353a23fdf1bc279/users/627cb766eae245bfae117d854b809efa/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.553346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b971250d5a435db353a23fdf1bc279, user_id=627cb766eae245bfae117d854b809efa, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.557277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.571773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1047/2081] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:24 2022] PUT /identity/v3/projects/06b971250d5a435db353a23fdf1bc279/users/627cb766eae245bfae117d854b809efa/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:24.581920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23714-e571-43ae-b033-b53be65355cf None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.582298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23714-e571-43ae-b033-b53be65355cf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.582698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23714-e571-43ae-b033-b53be65355cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.611194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-81e23714-e571-43ae-b033-b53be65355cf None None] MFA Rules not processed for user `627cb766eae245bfae117d854b809efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:24.612432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-81e23714-e571-43ae-b033-b53be65355cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:24.690825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1035/2082] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:24.695691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.756422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:24.781014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c864-8488-45e7-a716-30bf9b3362dd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.787090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.788002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.789187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.791022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.791022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.793466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.835893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1048/2083] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:24.840056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23714-e571-43ae-b033-b53be65355cf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:24.857820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23714-e571-43ae-b033-b53be65355cf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:24.950438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:24.951157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:24.952557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:24.955766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:24.956906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:24.963494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:24.999134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1036/2084] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:24 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:25.005804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.015449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adced2-3f90-461c-8a65-7bbf3031ce85 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.020904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.021658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.022012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.022297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.023657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.025298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.039361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1049/2085] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:25.048750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.066959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bfa81-b25d-440b-a8f3-016f417c04c2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.085744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.086656 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.086925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.087917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] PATH_INFO: `/v3/projects/0027d699c5434c1fa9a5a997cedc9f03/users/85c72e733e664c53a49950dbaabb8ef8/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.115016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0027d699c5434c1fa9a5a997cedc9f03, user_id=85c72e733e664c53a49950dbaabb8ef8, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.117874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.133762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1037/2086] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:25 2022] PUT /identity/v3/projects/0027d699c5434c1fa9a5a997cedc9f03/users/85c72e733e664c53a49950dbaabb8ef8/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:25.137915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.149357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ed03-e5e6-487a-b012-f671ac36081d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.209487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cded7c3-21fb-49c3-8b46-84512177a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.210779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded7c3-21fb-49c3-8b46-84512177a333 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.211058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded7c3-21fb-49c3-8b46-84512177a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.211336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded7c3-21fb-49c3-8b46-84512177a333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.212134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded7c3-21fb-49c3-8b46-84512177a333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.213749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded7c3-21fb-49c3-8b46-84512177a333 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.225127 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1050/2087] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:25.229806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.251674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e00d0-fb70-4745-832c-0f63c0d590bb admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.251674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.251674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.251674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.252125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] PATH_INFO: `/v3/projects/0027d699c5434c1fa9a5a997cedc9f03/users/85c72e733e664c53a49950dbaabb8ef8/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.252125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0027d699c5434c1fa9a5a997cedc9f03, user_id=85c72e733e664c53a49950dbaabb8ef8, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.253922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.265328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1038/2088] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:25 2022] PUT /identity/v3/projects/0027d699c5434c1fa9a5a997cedc9f03/users/85c72e733e664c53a49950dbaabb8ef8/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:25.277388 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.277922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.278054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.316106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] MFA Rules not processed for user `85c72e733e664c53a49950dbaabb8ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:25.317448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:25.395471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1051/2089] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:25.408151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.413494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:25.435637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:25.497317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226f1d-0f4f-4cfd-ae46-105fe7a083f8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.501267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c2969-c164-46aa-b131-4107a4da8679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.501914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c2969-c164-46aa-b131-4107a4da8679 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.502194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c2969-c164-46aa-b131-4107a4da8679 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.502467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c2969-c164-46aa-b131-4107a4da8679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.516175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c2969-c164-46aa-b131-4107a4da8679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.517645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c2969-c164-46aa-b131-4107a4da8679 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.529320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1039/2090] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:25.559331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.612373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:25.636420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a3f2-2c95-4c7b-95b2-ee44e36628cd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.641080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.641976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.642259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.642538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] PATH_INFO: `/v3/users/627cb766eae245bfae117d854b809efa` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.643804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=627cb766eae245bfae117d854b809efa)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.645778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.702376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627cb766eae245bfae117d854b809efa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:25.703041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627cb766eae245bfae117d854b809efa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:25.703679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627cb766eae245bfae117d854b809efa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:25.717609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627cb766eae245bfae117d854b809efa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:25.727686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627cb766eae245bfae117d854b809efa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:25.742691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1052/2091] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:25 2022] DELETE /identity/v3/users/627cb766eae245bfae117d854b809efa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:25.747295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.747660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.747940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.773665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:25.775023 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:25.837437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1040/2092] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:25.847189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:25.848762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:25.910969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fd4e4-bec5-4a41-b690-002ff8e462ba admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:25.915169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:25.915919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:25.916203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:25.916478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:25.926239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:25.927745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:25.938777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1053/2093] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:26.340683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:26.342137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:26.385140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86844e3-4ca7-413c-962f-88711a72915f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:26.393646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:26.394530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:26.394810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:26.395589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] PATH_INFO: `/v3/projects/06b971250d5a435db353a23fdf1bc279` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:26.396496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b971250d5a435db353a23fdf1bc279)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:26.399838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:26.477546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b971250d5a435db353a23fdf1bc279', 'request_id': 'req-cee56b5d-9544-4f98-be1c-ac4e38b758ce'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.492476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b971250d5a435db353a23fdf1bc279', 'request_id': 'req-cee56b5d-9544-4f98-be1c-ac4e38b758ce'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.499494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b971250d5a435db353a23fdf1bc279', 'request_id': 'req-cee56b5d-9544-4f98-be1c-ac4e38b758ce'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.514006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] The token cache is being invalidate because project 06b971250d5a435db353a23fdf1bc279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:26.515428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.515428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.516725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1041/2094] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:26 2022] DELETE /identity/v3/projects/06b971250d5a435db353a23fdf1bc279 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:26.520711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:26.531505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851866a-2b50-4f20-8a39-ed21c0b318d5 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:26.596375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:26.597309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:26.597589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:26.597862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] PATH_INFO: `/v3/users/85c72e733e664c53a49950dbaabb8ef8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:26.599110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c72e733e664c53a49950dbaabb8ef8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:26.601396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:26.614965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:26.648355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c72e733e664c53a49950dbaabb8ef8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.649012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c72e733e664c53a49950dbaabb8ef8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.649617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c72e733e664c53a49950dbaabb8ef8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.662055 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c72e733e664c53a49950dbaabb8ef8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.669126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef4b237f-8716-4aca-8484-ab99460cdccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c72e733e664c53a49950dbaabb8ef8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:26.682626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1054/2095] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:26 2022] DELETE /identity/v3/users/85c72e733e664c53a49950dbaabb8ef8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:26.971483 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:26.973282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:26.986641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56b5d-9544-4f98-be1c-ac4e38b758ce admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.029308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:27.054603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.056047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.056720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.057002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] PATH_INFO: `/v3/projects/0027d699c5434c1fa9a5a997cedc9f03` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.058209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0027d699c5434c1fa9a5a997cedc9f03)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.061409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.114692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0027d699c5434c1fa9a5a997cedc9f03', 'request_id': 'req-1a6c6097-1a4d-4594-afd5-97497ec802c0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:27.123638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0027d699c5434c1fa9a5a997cedc9f03', 'request_id': 'req-1a6c6097-1a4d-4594-afd5-97497ec802c0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:27.129130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0027d699c5434c1fa9a5a997cedc9f03', 'request_id': 'req-1a6c6097-1a4d-4594-afd5-97497ec802c0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:27.141826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] The token cache is being invalidate because project 0027d699c5434c1fa9a5a997cedc9f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:27.142115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:27.142771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a6c6097-1a4d-4594-afd5-97497ec802c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:27.144347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1042/2096] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:26 2022] DELETE /identity/v3/projects/0027d699c5434c1fa9a5a997cedc9f03 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:27.149357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.149649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.149954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.168637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:27.169964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:27.230220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1055/2097] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:27.238554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.238851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.239143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.259928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:27.261143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:27.269161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1043/2098] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:27.273519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.283254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33dd57-8909-4d8f-8935-50b7ba16612d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.287805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.288974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.289252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.289523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.290249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:27.290620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.292183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.308979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1056/2099] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:44:27.310130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.319861 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7eb9af-2ce7-475e-9956-8dbe8d7575cd None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.326001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.327112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.327303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.327619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.328330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.330374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.363083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1044/2100] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:27 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:27.367963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.379368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef3c6-1314-463f-87e4-915b036b4515 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.473210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.473922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.474208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.474485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.475587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.483901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.521422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1057/2101] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:27 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:27.532933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.544579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715550-9f08-44b1-839b-dc76ad8673f5 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.549573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.550247 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.550528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.550801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.551720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.553325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.573940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1045/2102] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:27.578054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.597042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780e52-cc8d-4929-a531-4a8836b0c445 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.605255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0cdaa-df8a-4146-a0f2-e91e68b3af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.606140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cdaa-df8a-4146-a0f2-e91e68b3af97 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.606578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cdaa-df8a-4146-a0f2-e91e68b3af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.607224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cdaa-df8a-4146-a0f2-e91e68b3af97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.608309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0cdaa-df8a-4146-a0f2-e91e68b3af97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.611054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0cdaa-df8a-4146-a0f2-e91e68b3af97 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.624231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:27.629196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1058/2103] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:27.632786 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.646594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0dcb-c7c9-4b2c-95dc-c415abc1cc12 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:27.653468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:27.655857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.656250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.656529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] PATH_INFO: `/v3/projects/d8607930e2354ab6ac55d41b682924d5/users/368d569938a84ab98ea0f60126f60741/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.730377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8607930e2354ab6ac55d41b682924d5, user_id=368d569938a84ab98ea0f60126f60741, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:27.733559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:27.754714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1046/2104] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:27 2022] PUT /identity/v3/projects/d8607930e2354ab6ac55d41b682924d5/users/368d569938a84ab98ea0f60126f60741/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:27.765196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:27.766134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:27.766490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:27.806376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] MFA Rules not processed for user `368d569938a84ab98ea0f60126f60741`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:27.807871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:27.901014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1059/2105] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:27.905522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:27.986553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f160ec-da44-4fc9-a484-b24017c012ad admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.009634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.009634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.009634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.009634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.010214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.012004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.033838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:28.059563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1047/2106] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:27 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:28.062283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.082754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d726bff-868c-45c3-9d43-ac33ad61f846 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.157173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.158176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.158492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.158896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.159650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.161585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.184875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1060/2107] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:28 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:28.188792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.202741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be181e1f-3533-4d6a-af75-f3028ca419c8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.207648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.208320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.208608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.208890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.209658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.211414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.232112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1048/2108] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:28.233231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.244468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a8f32-44aa-471f-a25e-92413b9aec6a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.249557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.250536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.250893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.251357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] PATH_INFO: `/v3/projects/0a5416bcf9ca430998a12b0b844f3b6c/users/eacb5c84a6de4c6a975b93600ecb71eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.270415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5416bcf9ca430998a12b0b844f3b6c, user_id=eacb5c84a6de4c6a975b93600ecb71eb, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.273205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.286973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1061/2109] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:28 2022] PUT /identity/v3/projects/0a5416bcf9ca430998a12b0b844f3b6c/users/eacb5c84a6de4c6a975b93600ecb71eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:28.291508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.304839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90338e7-a0c4-4d43-bfd5-6d13fde9146b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.365731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8a14e-7bec-4fc9-9793-a9edb25a7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.367028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a14e-7bec-4fc9-9793-a9edb25a7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.367314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a14e-7bec-4fc9-9793-a9edb25a7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.367625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a14e-7bec-4fc9-9793-a9edb25a7fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.368345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8a14e-7bec-4fc9-9793-a9edb25a7fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.369977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8a14e-7bec-4fc9-9793-a9edb25a7fa2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.384033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1049/2110] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:28.385532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.396677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681dc74-ec69-445c-9d5a-21ace21ebf74 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.401893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.402791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.403074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.403350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] PATH_INFO: `/v3/projects/0a5416bcf9ca430998a12b0b844f3b6c/users/eacb5c84a6de4c6a975b93600ecb71eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.405351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5416bcf9ca430998a12b0b844f3b6c, user_id=eacb5c84a6de4c6a975b93600ecb71eb, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.408059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.424387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1062/2111] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:28 2022] PUT /identity/v3/projects/0a5416bcf9ca430998a12b0b844f3b6c/users/eacb5c84a6de4c6a975b93600ecb71eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:28.439381 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.439970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.440480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.475077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] MFA Rules not processed for user `eacb5c84a6de4c6a975b93600ecb71eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:28.477482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:28.560901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1050/2112] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:28.571525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.573232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:28.623309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:28.642256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aabcb-8183-4479-9388-0e29b3fffee9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.645978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.646624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.646911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.647187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.657048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.658731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.669324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1063/2113] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:28.749961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:28.762707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5421-dd27-426d-8dbd-10b6503181e4 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:28.766482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:28.767133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:28.767446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:28.767722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:28.825695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:28.827195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:28.837015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1051/2114] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:29.753397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:29.762071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c3f58-7841-42c7-84ff-995be9b2cc2b service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:29.765646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:29.766281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:29.766569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:29.766848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:29.768634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:29.834158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:29.835792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194e3e-ebfe-4737-ac52-cd379a320c0c service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:29.847760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1064/2115] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:30.496926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:30.498456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:30.506227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:30.595896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89e02-6b9d-4abd-b896-037facd1ca02 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:30.602427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:30.603541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:30.603827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:30.604267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] PATH_INFO: `/v3/users/d2fda32283284da3870e98a18e281da1` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:30.605489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2fda32283284da3870e98a18e281da1)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:30.607675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:30.661779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2fda32283284da3870e98a18e281da1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:30.662438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2fda32283284da3870e98a18e281da1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:30.663441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2fda32283284da3870e98a18e281da1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:30.676686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2fda32283284da3870e98a18e281da1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:30.685677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2fda32283284da3870e98a18e281da1'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:30.701416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1052/2116] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:30 2022] DELETE /identity/v3/users/d2fda32283284da3870e98a18e281da1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:30.705970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:30.706355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:30.706567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:30.726834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:30.728244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:30.806688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1065/2117] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:30.813296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:30.814923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:30.885902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9036d-49f2-4a84-b09b-e8119f95a381 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:30.889884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7895ea-8dad-4e48-a3a8-a70ae9626f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:30.890540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7895ea-8dad-4e48-a3a8-a70ae9626f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:30.890827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7895ea-8dad-4e48-a3a8-a70ae9626f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:30.891106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7895ea-8dad-4e48-a3a8-a70ae9626f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:30.900148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7895ea-8dad-4e48-a3a8-a70ae9626f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:30.901572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7895ea-8dad-4e48-a3a8-a70ae9626f48 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:30.912370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1053/2118] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:31.184671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.186405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:31.202988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb427b4-7905-4bd9-9c61-5eb59bba6031 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.207887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.208609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.208896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.209172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] PATH_INFO: `/v3/projects/bfab560d0589400585f4c1b2587a811e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.210376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfab560d0589400585f4c1b2587a811e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.213332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.266337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfab560d0589400585f4c1b2587a811e', 'request_id': 'req-1874d68a-8edc-4395-8b0d-c1f00a1231dd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:31.275741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfab560d0589400585f4c1b2587a811e', 'request_id': 'req-1874d68a-8edc-4395-8b0d-c1f00a1231dd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:31.283851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfab560d0589400585f4c1b2587a811e', 'request_id': 'req-1874d68a-8edc-4395-8b0d-c1f00a1231dd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:31.293534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:31.300522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] The token cache is being invalidate because project bfab560d0589400585f4c1b2587a811e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:31.300811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:31.301536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1874d68a-8edc-4395-8b0d-c1f00a1231dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:31.303507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1066/2119] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:31 2022] DELETE /identity/v3/projects/bfab560d0589400585f4c1b2587a811e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:31.309409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.309772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.310139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.330157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:31.331401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:31.352213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:31.398175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1054/2120] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:31.406845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.407137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.407444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.427436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:31.428673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:31.436652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1067/2121] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:31.440781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.450577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca361c-7f39-4fd1-9950-22f87785f30d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.455170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.455867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.456156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.456435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.457167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:31.457478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.459093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.471689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1055/2122] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:31.476929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.486216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4965f0-3993-4a9f-aa84-970570a806c0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.491090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.491816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.492101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.492374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.493079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.494985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.521509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1068/2123] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:31.526257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.536331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b250-154d-41a0-80ce-e4ecf3f37735 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.593632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.594375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.594567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.594843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.595679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.597582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.620994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1056/2124] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:31.624811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.635373 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1e08-1b5d-4567-ba1f-3edd2326c8cd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.640367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.641146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.641496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.641926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.642716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.644476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.660439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1069/2125] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:31.664311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.674718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a44c-2da2-4175-b0ab-5140b73113ff admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.679777 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cf458-e897-4e69-a612-a5b3417a8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.680437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cf458-e897-4e69-a612-a5b3417a8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.680725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cf458-e897-4e69-a612-a5b3417a8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.681005 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cf458-e897-4e69-a612-a5b3417a8e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.681743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cf458-e897-4e69-a612-a5b3417a8e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.683789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cf458-e897-4e69-a612-a5b3417a8e51 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.694318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1057/2126] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:31.698529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.708419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5d8dc-cbf7-46f4-bdf4-8f4485f948e8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.713646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.714542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.714827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.715104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] PATH_INFO: `/v3/projects/8247d561a38c4d3586c66b7dddcdb567/users/816fadbb99cd42208a7bb93fd30c3731/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.732306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8247d561a38c4d3586c66b7dddcdb567, user_id=816fadbb99cd42208a7bb93fd30c3731, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.735150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:31.749338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1070/2127] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:31 2022] PUT /identity/v3/projects/8247d561a38c4d3586c66b7dddcdb567/users/816fadbb99cd42208a7bb93fd30c3731/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:31.760412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.760707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.760987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.791794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] MFA Rules not processed for user `816fadbb99cd42208a7bb93fd30c3731`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:31.793393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:31.879753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1058/2128] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:31.880738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:31.974119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6f28-7057-4494-99c7-dd19f44a1b29 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:31.984047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:31.984741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.985030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.985610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.986161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:31.988186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.025425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1071/2129] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:32.037354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.059174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d01b8f-59e5-468d-9c55-10b74beeb6a0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.075031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:32.123412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.123570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.123817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.124088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.124785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.126754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.149791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1059/2130] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:32 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:32.153999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.164946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4076-9691-4e23-b0a0-de73c6ade692 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.179576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.179576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.179576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.179576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.179940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.179940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.191472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1072/2131] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:32.195454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.206441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517110a-51f3-42b7-a5ab-f3ca95ac4f3a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.211923 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.212829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.213145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.213511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] PATH_INFO: `/v3/projects/4da42244d83540c8b86215ac1dfaa915/users/5ffeed1e44a64bfbad5aa9b4715f5179/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.240537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da42244d83540c8b86215ac1dfaa915, user_id=5ffeed1e44a64bfbad5aa9b4715f5179, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.244467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.261141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1060/2132] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:32 2022] PUT /identity/v3/projects/4da42244d83540c8b86215ac1dfaa915/users/5ffeed1e44a64bfbad5aa9b4715f5179/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:32.265118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.276234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95799b-7362-46a6-9843-98ebff0464b6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.338708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a18928-3765-4656-be8e-902a5671bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.339594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a18928-3765-4656-be8e-902a5671bcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.340003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a18928-3765-4656-be8e-902a5671bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.340439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a18928-3765-4656-be8e-902a5671bcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.341211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a18928-3765-4656-be8e-902a5671bcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.342808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a18928-3765-4656-be8e-902a5671bcd8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.357068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1073/2133] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:32.358441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.369070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dfc60-1f84-4e0a-8d9d-871d3297f920 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.374198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.375076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.375357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.375661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] PATH_INFO: `/v3/projects/4da42244d83540c8b86215ac1dfaa915/users/5ffeed1e44a64bfbad5aa9b4715f5179/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.377645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da42244d83540c8b86215ac1dfaa915, user_id=5ffeed1e44a64bfbad5aa9b4715f5179, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.380392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.396212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1061/2134] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:32 2022] PUT /identity/v3/projects/4da42244d83540c8b86215ac1dfaa915/users/5ffeed1e44a64bfbad5aa9b4715f5179/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:32.404115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.404322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.404617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.414304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:32.445517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] MFA Rules not processed for user `5ffeed1e44a64bfbad5aa9b4715f5179`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:32.445517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:32.567438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1074/2135] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:32.580504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.580504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:32.647107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698432f-2926-419e-bebf-9e6bf6d55391 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.651833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.652519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.652877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.653178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.664710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.666206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.678178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1062/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:32.765179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.766669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:32.780146 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aeebc-a434-4008-9420-2b890ffd5678 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.784258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e98617-7413-4cba-8ff9-40280581276f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.784934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e98617-7413-4cba-8ff9-40280581276f service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.785234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e98617-7413-4cba-8ff9-40280581276f service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.785515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e98617-7413-4cba-8ff9-40280581276f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.852097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e98617-7413-4cba-8ff9-40280581276f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.853688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e98617-7413-4cba-8ff9-40280581276f service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.863397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1075/2137] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:33.071510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:33.072901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:33.144312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2e74-b020-43c9-b49f-ed16318f617d service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:33.150195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:33.151195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:33.151583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:33.151865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] PATH_INFO: `/v3/users/4e52d439bf1e483a82fad41cd8ae3f0b` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:33.153315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e52d439bf1e483a82fad41cd8ae3f0b)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:33.155269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:33.174153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:33.205562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e52d439bf1e483a82fad41cd8ae3f0b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.206215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e52d439bf1e483a82fad41cd8ae3f0b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.206817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e52d439bf1e483a82fad41cd8ae3f0b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.219093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e52d439bf1e483a82fad41cd8ae3f0b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.226653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e52d439bf1e483a82fad41cd8ae3f0b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.239413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1063/2138] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:33 2022] DELETE /identity/v3/users/4e52d439bf1e483a82fad41cd8ae3f0b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:33.244065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:33.244554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:33.244770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:33.264666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:33.265859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:33.324498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1076/2139] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:33.334367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:33.336368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:33.393486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0d53-daa1-4d80-b0a8-c205c4797438 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:33.397271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:33.398462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:33.398743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:33.399014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:33.407992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:33.409435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:33.418787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1064/2140] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:33.691203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:33.692998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:33.709483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc50c4-f76b-4f5c-9f16-50733e02de79 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:33.716318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:33.717662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:33.717909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:33.718194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] PATH_INFO: `/v3/projects/8d326f182e26442fbea27310fa2ca4ab` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:33.719490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d326f182e26442fbea27310fa2ca4ab)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:33.721421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:33.749352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:33.785550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d326f182e26442fbea27310fa2ca4ab', 'request_id': 'req-133f8173-c416-4722-8816-5c344469b79a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.794813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d326f182e26442fbea27310fa2ca4ab', 'request_id': 'req-133f8173-c416-4722-8816-5c344469b79a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.801623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d326f182e26442fbea27310fa2ca4ab', 'request_id': 'req-133f8173-c416-4722-8816-5c344469b79a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.818914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] The token cache is being invalidate because project 8d326f182e26442fbea27310fa2ca4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:33.819201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.822463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-133f8173-c416-4722-8816-5c344469b79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:33.824123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1077/2141] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:33 2022] DELETE /identity/v3/projects/8d326f182e26442fbea27310fa2ca4ab => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:33.926844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:33.928456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:33.942678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52340-1252-4eb3-93d9-2b93a1077453 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:34.003542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:34.004449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.004737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.005018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] PATH_INFO: `/v3/users/368d569938a84ab98ea0f60126f60741` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.006260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368d569938a84ab98ea0f60126f60741)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:34.008354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:34.050235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:34.058257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368d569938a84ab98ea0f60126f60741'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.059171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368d569938a84ab98ea0f60126f60741'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.059902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368d569938a84ab98ea0f60126f60741'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.074353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368d569938a84ab98ea0f60126f60741'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.081047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368d569938a84ab98ea0f60126f60741'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.096543 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1065/2142] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:33 2022] DELETE /identity/v3/users/368d569938a84ab98ea0f60126f60741 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:34.101429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.101794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.102149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.123014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:34.124369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:34.191087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1078/2143] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:34.201307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:34.203170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:34.274724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79f020-5086-48e7-8800-9f722a7eee04 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:34.279302 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:34.279992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.280275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.280547 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.290562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:34.292261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:34.307099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1066/2144] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:34.660832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:34.662277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:34.676539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a6e8-4dd3-4fd1-82b9-b7f473798011 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:34.683586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:34.684688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.685092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.685472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] PATH_INFO: `/v3/projects/d8607930e2354ab6ac55d41b682924d5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.686907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8607930e2354ab6ac55d41b682924d5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:34.689275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:34.736153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8607930e2354ab6ac55d41b682924d5', 'request_id': 'req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.744249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8607930e2354ab6ac55d41b682924d5', 'request_id': 'req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.750117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8607930e2354ab6ac55d41b682924d5', 'request_id': 'req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.762113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] The token cache is being invalidate because project d8607930e2354ab6ac55d41b682924d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:34.762397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.763048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.764592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1079/2145] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:34 2022] DELETE /identity/v3/projects/d8607930e2354ab6ac55d41b682924d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:34.768581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:34.778231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902a4f-99a0-4776-a183-8b75cdf90f32 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:34.838374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:34.839277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.839619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.839894 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] PATH_INFO: `/v3/users/eacb5c84a6de4c6a975b93600ecb71eb` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.841095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacb5c84a6de4c6a975b93600ecb71eb)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:34.843016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:34.892570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacb5c84a6de4c6a975b93600ecb71eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.893246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacb5c84a6de4c6a975b93600ecb71eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.893855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacb5c84a6de4c6a975b93600ecb71eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.906185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:34.908764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacb5c84a6de4c6a975b93600ecb71eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.917400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-08065378-4978-4fd8-8a4a-64fca6974ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacb5c84a6de4c6a975b93600ecb71eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:34.932029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1067/2146] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:34 2022] DELETE /identity/v3/users/eacb5c84a6de4c6a975b93600ecb71eb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:35.412196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:35.413627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:35.427951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3eeb5-c565-41cb-a1aa-61ffcf28aba8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:35.463245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:35.498635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:35.499539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:35.499822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:35.500095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] PATH_INFO: `/v3/projects/0a5416bcf9ca430998a12b0b844f3b6c` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:35.501280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5416bcf9ca430998a12b0b844f3b6c)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:35.503208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:35.558430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5416bcf9ca430998a12b0b844f3b6c', 'request_id': 'req-823e9983-2025-47d3-b029-8c8c2787ab4b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:35.567845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5416bcf9ca430998a12b0b844f3b6c', 'request_id': 'req-823e9983-2025-47d3-b029-8c8c2787ab4b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:35.572873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5416bcf9ca430998a12b0b844f3b6c', 'request_id': 'req-823e9983-2025-47d3-b029-8c8c2787ab4b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:35.585986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] The token cache is being invalidate because project 0a5416bcf9ca430998a12b0b844f3b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:35.586276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:35.586946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-823e9983-2025-47d3-b029-8c8c2787ab4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:35.588753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1080/2147] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:35 2022] DELETE /identity/v3/projects/0a5416bcf9ca430998a12b0b844f3b6c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:35.593497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:35.593791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:35.594188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:35.619960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:35.621291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:35.717397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1068/2148] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:35.719674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:35.720148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:35.720313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:35.746519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:35.748072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:35.769397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1081/2149] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:35.775440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:35.786957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cce5f-3ced-44be-9344-dddbc64c5864 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:35.793742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:35.794418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:35.795146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:35.795484 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:35.796216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:35.796629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:35.798366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:35.823332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1069/2150] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:35.827930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:35.844035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b8ca4-ed06-46e3-a4ce-46b38e7b9bb0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:35.852183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:35.861007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:35.862171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:35.862463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:35.866332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:35.869128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:35.907849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1082/2151] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:35 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:35.909246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:35.920610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62988a4-3a38-487c-8706-34992bf380d2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:35.993994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:35.995624 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:35.996206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:35.996751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:35.997804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:35.999881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:36.034031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1070/2152] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:35 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:36.037940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:36.056403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95c4ba-142a-403c-aba9-94e056f51c14 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:36.061656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:36.062470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:36.062827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:36.063254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:36.064169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:36.065853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:36.077414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1083/2153] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:36.081149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:36.092269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc98fa-003d-4767-a9b1-b2a5d2365c83 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:36.097112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8df45-ed2f-47f5-9170-4dbfdc046872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:36.097895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8df45-ed2f-47f5-9170-4dbfdc046872 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:36.098298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8df45-ed2f-47f5-9170-4dbfdc046872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:36.098647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8df45-ed2f-47f5-9170-4dbfdc046872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:36.099490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8df45-ed2f-47f5-9170-4dbfdc046872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:36.102246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8df45-ed2f-47f5-9170-4dbfdc046872 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:36.114007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1071/2154] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:36.118496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:36.129184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd21fe-a81d-405e-87a8-8613e38d1ce1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:36.134221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:36.135115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:36.135424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:36.135711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] PATH_INFO: `/v3/projects/40949b339f114d99be43b70cb7fb576e/users/b99c1c3a0e724057a21cfcc3a9f310fc/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:36.154038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40949b339f114d99be43b70cb7fb576e, user_id=b99c1c3a0e724057a21cfcc3a9f310fc, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:36.156771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:36.170820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1084/2155] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:36 2022] PUT /identity/v3/projects/40949b339f114d99be43b70cb7fb576e/users/b99c1c3a0e724057a21cfcc3a9f310fc/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:36.183157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:36.183596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:36.183900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:36.213819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] MFA Rules not processed for user `b99c1c3a0e724057a21cfcc3a9f310fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:36.215079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:36.251927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:36.287757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1072/2156] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:36.299266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:36.301216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:36.362700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311b8f-63a4-4161-ad7c-cbd387e57b4e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:36.366493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0746-5bbb-4749-8831-a07df57ed355 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:36.367139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0746-5bbb-4749-8831-a07df57ed355 service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:36.367447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0746-5bbb-4749-8831-a07df57ed355 service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:36.367730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0746-5bbb-4749-8831-a07df57ed355 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:36.376542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f0746-5bbb-4749-8831-a07df57ed355 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:36.377967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f0746-5bbb-4749-8831-a07df57ed355 service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:36.387896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1085/2157] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:37.047592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:37.049121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.128139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac1c9-3472-4ff4-97a6-bf2bcc98f879 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:37.136061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:37.140037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:37.140500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:37.140851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] PATH_INFO: `/v3/users/c3a54da9dcf0412bb2eee3f86650263d` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:37.142190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a54da9dcf0412bb2eee3f86650263d)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:37.144347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:37.208390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a54da9dcf0412bb2eee3f86650263d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:37.209418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a54da9dcf0412bb2eee3f86650263d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:37.210573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a54da9dcf0412bb2eee3f86650263d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:37.230130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a54da9dcf0412bb2eee3f86650263d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:37.240346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a54da9dcf0412bb2eee3f86650263d'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:37.266163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1073/2158] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:37 2022] DELETE /identity/v3/users/c3a54da9dcf0412bb2eee3f86650263d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:37.272544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:37.273108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:37.273108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:37.284661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:37.300643 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:37.307846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.410467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1086/2159] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:37.417680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:37.419180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.551580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42145f53-055f-4a5e-bd97-2324450efbb2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:37.560453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101cd04-2a20-4d5a-932b-f9b73182a602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:37.562194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cd04-2a20-4d5a-932b-f9b73182a602 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:37.562588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cd04-2a20-4d5a-932b-f9b73182a602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:37.563721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cd04-2a20-4d5a-932b-f9b73182a602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:37.584450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:37.591927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101cd04-2a20-4d5a-932b-f9b73182a602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:37.596650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101cd04-2a20-4d5a-932b-f9b73182a602 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:37.622568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1074/2160] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:37.955410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:37.956981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.969418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387ae82-ad83-423d-bd8d-54d7db6c8056 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:37.978663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:37.979668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:37.979955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:37.980386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] PATH_INFO: `/v3/projects/05eca0755ef6445d8afc38e119e84c08` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:37.982887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eca0755ef6445d8afc38e119e84c08)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:37.985651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.052532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eca0755ef6445d8afc38e119e84c08', 'request_id': 'req-f156104e-c09e-4539-a179-e800b00ae521'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:38.062064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eca0755ef6445d8afc38e119e84c08', 'request_id': 'req-f156104e-c09e-4539-a179-e800b00ae521'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:38.068374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eca0755ef6445d8afc38e119e84c08', 'request_id': 'req-f156104e-c09e-4539-a179-e800b00ae521'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:38.081452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] The token cache is being invalidate because project 05eca0755ef6445d8afc38e119e84c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:38.081949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:38.083161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f156104e-c09e-4539-a179-e800b00ae521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:38.085280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1087/2161] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:37 2022] DELETE /identity/v3/projects/05eca0755ef6445d8afc38e119e84c08 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:38.089963 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.090431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.090925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.114742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:38.115984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:38.181733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1075/2162] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:38.189725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.190018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.190300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.210029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:38.211701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:38.219617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1088/2163] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:38.224087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.234853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b58e-b7ee-4756-b344-76391bc2c296 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.239403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.240070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.240354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.240630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.241375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:38.241744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.243421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.255298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1076/2164] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:38.259863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.269201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47caf-357b-471b-a6c5-38edec99e98d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.274397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.275045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.275328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.275634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.276321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.278250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.306344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1089/2165] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:38 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:38.310565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.320584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1149e-b951-4092-9251-75a0d8f36fd2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.382096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.382718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.382997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.383267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.383992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.386090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.410737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1077/2166] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:38 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:38.411951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.422832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb839982-f815-4bf5-8631-c7da01a0ce3e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.427419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.428151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.428436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.428717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.429454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.431063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.440884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1090/2167] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:38.444899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.455553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024042d-aed6-499a-90b0-d212604297f9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.461009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65ddf4-c5ab-425b-bf10-95d8123db427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.461666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65ddf4-c5ab-425b-bf10-95d8123db427 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.461903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65ddf4-c5ab-425b-bf10-95d8123db427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.462187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65ddf4-c5ab-425b-bf10-95d8123db427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.463036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65ddf4-c5ab-425b-bf10-95d8123db427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.464673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65ddf4-c5ab-425b-bf10-95d8123db427 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.477233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1078/2168] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:38.481064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.491258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54af54-b425-4b89-a631-2262017b7381 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.495834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.496712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.496993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.497295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] PATH_INFO: `/v3/projects/ccd4983b26e742ab91488503d3c4a515/users/068418c8cb1246b497a3f8ca39c5c782/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.512461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd4983b26e742ab91488503d3c4a515, user_id=068418c8cb1246b497a3f8ca39c5c782, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.515193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.541470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1091/2169] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:38 2022] PUT /identity/v3/projects/ccd4983b26e742ab91488503d3c4a515/users/068418c8cb1246b497a3f8ca39c5c782/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:38.544413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.544707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.544989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.573131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] MFA Rules not processed for user `068418c8cb1246b497a3f8ca39c5c782`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:38.574350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:38.621734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:38.643889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1079/2170] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:38.652732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:38.654546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:38.688426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:38.722281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9331-2bdd-425f-a875-47a9247b8024 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:38.726927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5b316-38b6-45db-bea7-042a8ff6bea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:38.727599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5b316-38b6-45db-bea7-042a8ff6bea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:38.727884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5b316-38b6-45db-bea7-042a8ff6bea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:38.728161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5b316-38b6-45db-bea7-042a8ff6bea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:38.737176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5b316-38b6-45db-bea7-042a8ff6bea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:38.738601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5b316-38b6-45db-bea7-042a8ff6bea5 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:38.748404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1092/2171] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:41.879886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:41.947064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9cc6f-5beb-4056-871a-c9a8a1a38b30 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:41.951780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:41.952697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:41.953002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:41.953332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] PATH_INFO: `/v3/users/068418c8cb1246b497a3f8ca39c5c782` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:41.954636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068418c8cb1246b497a3f8ca39c5c782)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:41.956636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.005717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068418c8cb1246b497a3f8ca39c5c782'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.006375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068418c8cb1246b497a3f8ca39c5c782'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.007216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068418c8cb1246b497a3f8ca39c5c782'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.019878 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068418c8cb1246b497a3f8ca39c5c782'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.028902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068418c8cb1246b497a3f8ca39c5c782'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.043889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1080/2172] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:41 2022] DELETE /identity/v3/users/068418c8cb1246b497a3f8ca39c5c782 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:42.048559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.049026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.049142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.068818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:42.070056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.141219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1093/2173] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:42.152539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.154060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.213788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d5b0-931e-4af2-a8a8-501e31e8b4f6 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:42.218682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4435dc-f831-4ea2-ade8-fe63e1c76e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:42.219338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4435dc-f831-4ea2-ade8-fe63e1c76e76 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.219653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4435dc-f831-4ea2-ade8-fe63e1c76e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.219933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4435dc-f831-4ea2-ade8-fe63e1c76e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.230862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4435dc-f831-4ea2-ade8-fe63e1c76e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:42.232447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4435dc-f831-4ea2-ade8-fe63e1c76e76 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.243900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1081/2174] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:42.517450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.519184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.533616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d8fed-4b53-4bfb-a920-ad427dce5386 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:42.539197 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:42.540168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.540607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.541030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] PATH_INFO: `/v3/projects/ccd4983b26e742ab91488503d3c4a515` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.542453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd4983b26e742ab91488503d3c4a515)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:42.544716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.611576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd4983b26e742ab91488503d3c4a515', 'request_id': 'req-d5941d93-57eb-4f2e-beed-8f6d0b132cae'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.620221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd4983b26e742ab91488503d3c4a515', 'request_id': 'req-d5941d93-57eb-4f2e-beed-8f6d0b132cae'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.626174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd4983b26e742ab91488503d3c4a515', 'request_id': 'req-d5941d93-57eb-4f2e-beed-8f6d0b132cae'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.638069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] The token cache is being invalidate because project ccd4983b26e742ab91488503d3c4a515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:42.638391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.639035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5941d93-57eb-4f2e-beed-8f6d0b132cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:42.640744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1094/2175] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:42 2022] DELETE /identity/v3/projects/ccd4983b26e742ab91488503d3c4a515 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:42.645775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.646068 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.646482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.667411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:42.668756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.677252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:42.733961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1082/2176] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:42.741908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.742738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.743031 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.764246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:42.765391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.778343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1095/2177] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:42.782809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.793087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419da9e3-a814-42b7-9f66-8a5287b8f577 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:42.798976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:42.799697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.799987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.800267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.801039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:42.801338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:42.802993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.816708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1083/2178] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:42.821701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.834845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c4126-a9c2-4417-acf9-da6745c8e3a7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:42.840466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:42.841317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.841463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.841910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.842637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:42.846497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.877257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1096/2179] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:42 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:42.881347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.895412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a5c62-b059-418b-a334-748f500fb4e9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:42.956531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:42.957228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.957520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.957800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.958495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:42.960489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.985882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1084/2180] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:42 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:42.987340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.998537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab03562-9680-49aa-8a35-696d696da838 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.003287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.004366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.004958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.005554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.006961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.009969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.022614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1097/2181] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:43.026860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.037755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd5b9-ff4d-4d6d-8590-cbce11a1855a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.045840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733209a-ad12-4df7-95b2-7ad37612703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.046516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733209a-ad12-4df7-95b2-7ad37612703f admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.046803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733209a-ad12-4df7-95b2-7ad37612703f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.047075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733209a-ad12-4df7-95b2-7ad37612703f admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.047857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733209a-ad12-4df7-95b2-7ad37612703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.049490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733209a-ad12-4df7-95b2-7ad37612703f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.061350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1085/2182] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:43.066158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.076670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523dcc0-065a-4919-ac8d-6c5b9d68288e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.081553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.082456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.082745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.083026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] PATH_INFO: `/v3/projects/b28ba38c16b744629fed3414f8ce1235/users/b018b8314b4045209a96d505980e09bf/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.092198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:43.101255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ba38c16b744629fed3414f8ce1235, user_id=b018b8314b4045209a96d505980e09bf, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.104754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.118994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1098/2183] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:43 2022] PUT /identity/v3/projects/b28ba38c16b744629fed3414f8ce1235/users/b018b8314b4045209a96d505980e09bf/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:43.129709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.130127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.130397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.173467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] MFA Rules not processed for user `b018b8314b4045209a96d505980e09bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:43.175124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:43.267088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1086/2184] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:43.267195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.335238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5d9f-87ea-4820-8c92-f0a8e507181d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.340345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.341003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.341283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.341556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.342245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.344177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.384707 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1099/2185] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:43 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:43.385683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.402387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf29cc-16ac-45be-afd7-e44da4e28c8d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.407316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:43.463363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.464056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.464365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.464640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.465453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.467706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.489064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1087/2186] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:43 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:43.493120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.503272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f095-c669-40c5-b1fe-61ef369bae69 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.508361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.508869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.509242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.509671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.510828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.512859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.526404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1100/2187] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:43.530164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.540917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c0b84-5ffd-40dd-9b75-6c849a808d01 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.545522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ba5ec-e9f3-48f6-812d-672359ae7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.546173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ba5ec-e9f3-48f6-812d-672359ae7506 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.546459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ba5ec-e9f3-48f6-812d-672359ae7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.546731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ba5ec-e9f3-48f6-812d-672359ae7506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.547489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ba5ec-e9f3-48f6-812d-672359ae7506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.549076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ba5ec-e9f3-48f6-812d-672359ae7506 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.559107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1088/2188] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:43.563204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.581214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cb197-68e4-4256-9694-50ba4631fe6e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.586647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.587576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.587862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.588134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] PATH_INFO: `/v3/projects/f0798bd9fe1f4d4a8595081941e3f420/users/a6f7b23578fd4a01817817cb439cfd03/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.604108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0798bd9fe1f4d4a8595081941e3f420, user_id=a6f7b23578fd4a01817817cb439cfd03, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.606828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.619466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1101/2189] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:43 2022] PUT /identity/v3/projects/f0798bd9fe1f4d4a8595081941e3f420/users/a6f7b23578fd4a01817817cb439cfd03/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:43.630617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.630910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.631188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.661422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] MFA Rules not processed for user `a6f7b23578fd4a01817817cb439cfd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:43.662635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:43.728207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1089/2190] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:43.732615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.796056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec20b-d400-4700-9c96-832930033abd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.800714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.801376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.801654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.801926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.802628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.805181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.830951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1102/2191] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:43 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:43.834984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.847663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a97c6-6242-4711-8c0c-61d933816ccf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.912819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.913500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.917931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.918271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.919010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.921850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.947467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1090/2192] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:43 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:43.951411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:43.964236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2dd0d-b135-4cbb-b04a-d1f3cadf11e3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:43.969059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:43.969726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:43.970016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:43.970288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:43.971024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:43.972704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:43.987622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1103/2193] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:43.991232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:44.003875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568ff8-8ce5-4110-847c-eee9197401de admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:44.009811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:44.010984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:44.011467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:44.011907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] PATH_INFO: `/v3/projects/96314dd42a6d4606a1e31c241b212f9f/users/097e8b26f3404904b9c816cc259d58d6/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:44.014635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:44.029030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96314dd42a6d4606a1e31c241b212f9f, user_id=097e8b26f3404904b9c816cc259d58d6, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:44.032117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:44.050706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1091/2194] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:43 2022] PUT /identity/v3/projects/96314dd42a6d4606a1e31c241b212f9f/users/097e8b26f3404904b9c816cc259d58d6/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:44.051873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:44.062946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd44b2d-5fd1-4bfa-891a-edb6effc15ea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:44.077405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:44.147992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acec673-4334-4af2-9210-62cca161e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:44.149629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acec673-4334-4af2-9210-62cca161e061 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:44.150041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acec673-4334-4af2-9210-62cca161e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:44.150428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acec673-4334-4af2-9210-62cca161e061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:44.151285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acec673-4334-4af2-9210-62cca161e061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:44.153979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acec673-4334-4af2-9210-62cca161e061 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:44.168660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1104/2195] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:44.170172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:44.181370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c83e-7d21-48c6-bee8-9b4c334b1859 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:44.186413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:44.187460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:44.187816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:44.188163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] PATH_INFO: `/v3/projects/96314dd42a6d4606a1e31c241b212f9f/users/097e8b26f3404904b9c816cc259d58d6/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:44.190251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96314dd42a6d4606a1e31c241b212f9f, user_id=097e8b26f3404904b9c816cc259d58d6, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:44.193057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:44.203995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1092/2196] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:44 2022] PUT /identity/v3/projects/96314dd42a6d4606a1e31c241b212f9f/users/097e8b26f3404904b9c816cc259d58d6/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:44.214868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:44.215164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:44.215476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:44.263102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] MFA Rules not processed for user `097e8b26f3404904b9c816cc259d58d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:44.264402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:44.338014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1105/2197] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:44.348915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:44.351026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:44.413010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb5a7-9a7c-42eb-8695-22e54a8fa993 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:44.417689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:44.418336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:44.418622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:44.418900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:44.479787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:44.481235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:44.490318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1093/2198] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:46.057861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:46.059797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:46.071653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba502-2607-42fb-a028-98a6ea4aedda None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:46.075314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf5ea8-2c8e-4527-912a-09ed4739d413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:46.075988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf5ea8-2c8e-4527-912a-09ed4739d413 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:46.076331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf5ea8-2c8e-4527-912a-09ed4739d413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:46.076533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf5ea8-2c8e-4527-912a-09ed4739d413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:46.139777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf5ea8-2c8e-4527-912a-09ed4739d413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:46.141262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf5ea8-2c8e-4527-912a-09ed4739d413 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:46.156743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1106/2199] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:46.790818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:46.799649 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79521c57-45b8-4f26-b481-805a36944339 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:46.803560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e71cb-adc9-4eb4-9126-d1bad7e48683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:46.804286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e71cb-adc9-4eb4-9126-d1bad7e48683 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:46.804611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e71cb-adc9-4eb4-9126-d1bad7e48683 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:46.804891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e71cb-adc9-4eb4-9126-d1bad7e48683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:46.823111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e71cb-adc9-4eb4-9126-d1bad7e48683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:46.826653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e71cb-adc9-4eb4-9126-d1bad7e48683 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:46.838030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1094/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:50.018821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0426-4dbc-413f-95e2-feb846c11392 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:50.019314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0426-4dbc-413f-95e2-feb846c11392 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:50.019564 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0426-4dbc-413f-95e2-feb846c11392 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:50.021177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1107/2201] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:50.031016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:50.031548 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:50.032274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:50.056682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] MFA Rules not processed for user `6cc0a416829f433f8cd3867cde7214bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:50.060368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:50.154778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1095/2202] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:50.291682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0426-4dbc-413f-95e2-feb846c11392 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:50.293972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e08d0426-4dbc-413f-95e2-feb846c11392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:50.323074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0426-4dbc-413f-95e2-feb846c11392 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:50.331463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:50.332267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:50.332535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:50.333066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:50.342909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:50.344554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:50.356222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1108/2203] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:50.756897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:50.773741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:50.855672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f015aa-78fa-4cde-b6c1-06054655fb4a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:50.860156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:50.861196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:50.861482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:50.861759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] PATH_INFO: `/v3/users/b018b8314b4045209a96d505980e09bf` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:50.863074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b018b8314b4045209a96d505980e09bf)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:50.865499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:50.875346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:50.876903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:50.901911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c5ab-ee33-48ae-a4b3-e402f20af8cc service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:50.907339 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:50.909796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:50.910109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:50.910386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] PATH_INFO: `/v3/users/825a66d8f05d4532944f2c3d72f82bac` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:50.911795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825a66d8f05d4532944f2c3d72f82bac)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:50.914703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:50.925597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b018b8314b4045209a96d505980e09bf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.926246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b018b8314b4045209a96d505980e09bf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.926870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b018b8314b4045209a96d505980e09bf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.930256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:50.940059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b018b8314b4045209a96d505980e09bf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.947609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c699217a-6f64-4ee5-83b9-aa489f56229f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b018b8314b4045209a96d505980e09bf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.961332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1096/2204] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:50 2022] DELETE /identity/v3/users/b018b8314b4045209a96d505980e09bf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:50.966142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:50.966436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:50.966710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:50.969978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825a66d8f05d4532944f2c3d72f82bac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.970610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825a66d8f05d4532944f2c3d72f82bac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.971211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825a66d8f05d4532944f2c3d72f82bac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.984483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825a66d8f05d4532944f2c3d72f82bac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:50.986494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:50.987775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:50.991853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825a66d8f05d4532944f2c3d72f82bac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.004320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1109/2205] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:50 2022] DELETE /identity/v3/users/825a66d8f05d4532944f2c3d72f82bac => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:51.048161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1097/2206] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:51.057763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:51.059287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:51.118210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccca22-7ddb-4dff-b61c-7a9d8deaed68 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:51.122311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:51.122970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.123256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.123570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.178719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:51.180294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:51.186421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:51.187923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:51.200728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54f8aa-e026-484f-b9a4-0e5d80a1c10a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:51.205805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:51.206859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.207217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.207612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] PATH_INFO: `/v3/projects/b2f129d314e347d9af4b24c8d7109b42` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.209000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f129d314e347d9af4b24c8d7109b42)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:51.210708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1110/2207] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:51.219412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:51.269416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:51.309099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f129d314e347d9af4b24c8d7109b42', 'request_id': 'req-c00154cd-6321-4bbc-84e6-218bf24ae9c9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.322228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f129d314e347d9af4b24c8d7109b42', 'request_id': 'req-c00154cd-6321-4bbc-84e6-218bf24ae9c9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.332284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f129d314e347d9af4b24c8d7109b42', 'request_id': 'req-c00154cd-6321-4bbc-84e6-218bf24ae9c9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.347471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] The token cache is being invalidate because project b2f129d314e347d9af4b24c8d7109b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:51.347936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.348748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.351224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1098/2208] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:51 2022] DELETE /identity/v3/projects/b2f129d314e347d9af4b24c8d7109b42 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:51.355273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:51.372301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813bc8-d0f0-4846-9fd8-cb575c98e528 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:51.430038 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:51.458875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:51.459882 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.460232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.460513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] PATH_INFO: `/v3/users/cd0510b7d2ef4dce94104e1fbf5191bf` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.463200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0510b7d2ef4dce94104e1fbf5191bf)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:51.464747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:51.513614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0510b7d2ef4dce94104e1fbf5191bf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.514500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0510b7d2ef4dce94104e1fbf5191bf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.515096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0510b7d2ef4dce94104e1fbf5191bf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.529559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0510b7d2ef4dce94104e1fbf5191bf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.537112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0510b7d2ef4dce94104e1fbf5191bf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.554657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1111/2209] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:51 2022] DELETE /identity/v3/users/cd0510b7d2ef4dce94104e1fbf5191bf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:51.574025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:51.575827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:51.590464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00154cd-6321-4bbc-84e6-218bf24ae9c9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:51.662694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:51.663646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.663935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.664722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] PATH_INFO: `/v3/projects/b28ba38c16b744629fed3414f8ce1235` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.666048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28ba38c16b744629fed3414f8ce1235)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:51.668453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:51.720096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28ba38c16b744629fed3414f8ce1235', 'request_id': 'req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.727589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28ba38c16b744629fed3414f8ce1235', 'request_id': 'req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.735212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28ba38c16b744629fed3414f8ce1235', 'request_id': 'req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.749619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] The token cache is being invalidate because project b28ba38c16b744629fed3414f8ce1235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:51.749619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.749619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.750555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1099/2210] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:51 2022] DELETE /identity/v3/projects/b28ba38c16b744629fed3414f8ce1235 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:51.751166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:51.753232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:51.754072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:51.755594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:51.776636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994c177-791f-48fc-ba3c-00aa5f8ee5c7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:51.802580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:51.826947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a679-ddcc-41bc-b1eb-ca4d1d51b322 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:51.831673 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:51.832685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.832979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.833303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] PATH_INFO: `/v3/users/a6f7b23578fd4a01817817cb439cfd03` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.834604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f7b23578fd4a01817817cb439cfd03)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:51.836571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:51.838587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:51.839489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.839788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.840056 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] PATH_INFO: `/v3/projects/508d92d2e99f47d493fcb3cc886dcc1a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.841268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=508d92d2e99f47d493fcb3cc886dcc1a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:51.843234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:51.885928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f7b23578fd4a01817817cb439cfd03'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.886650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f7b23578fd4a01817817cb439cfd03'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.887295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f7b23578fd4a01817817cb439cfd03'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.889921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508d92d2e99f47d493fcb3cc886dcc1a', 'request_id': 'req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.897016 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508d92d2e99f47d493fcb3cc886dcc1a', 'request_id': 'req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.900385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f7b23578fd4a01817817cb439cfd03'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.905662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:51.908505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508d92d2e99f47d493fcb3cc886dcc1a', 'request_id': 'req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.908622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-b2edfa94-2627-4d57-8a32-0a7f4d2b4dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f7b23578fd4a01817817cb439cfd03'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.923661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] The token cache is being invalidate because project 508d92d2e99f47d493fcb3cc886dcc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:51.924188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.925011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1100/2211] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:51 2022] DELETE /identity/v3/users/a6f7b23578fd4a01817817cb439cfd03 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:51.925136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c6587a87-7ba3-4510-87f4-07a5dc2ad2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:51.926821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1112/2212] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:51 2022] DELETE /identity/v3/projects/508d92d2e99f47d493fcb3cc886dcc1a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:51.931261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:51.931647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:51.931936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:51.954143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:51.955365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.030188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1101/2213] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:52.037662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.037954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.038235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.060082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:52.061421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.077973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1113/2214] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:52.082294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.094890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7231128-ff9b-4fbc-bff0-bfc120a30391 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.109104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.109781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.110052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.110330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.111076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:52.111433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.112980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.140544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1102/2215] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:52.144414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.155768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dff69-968a-46db-96c6-cc3d074c92bd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.160666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.161435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.161791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.162074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.162778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.164746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.195673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1114/2216] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:52 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:52.200314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.210686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43505c1-dedb-4c92-9ef2-880e8ac3ecc7 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.250423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.252661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.276328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:52.295886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.296697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.296988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.297265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.297956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.300316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.327625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1103/2217] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:52 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:52.331755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.343868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb3cc-0305-48ef-a7a6-7b5dac10dfc4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.350281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.350960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.351260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.351574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.352320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.354125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1c64-e75c-4bf2-a2d1-d4380ccbd3e3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.354574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.359692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.360625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.360910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.361192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] PATH_INFO: `/v3/projects/f0798bd9fe1f4d4a8595081941e3f420` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.363285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0798bd9fe1f4d4a8595081941e3f420)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.365114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.369422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1104/2218] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:52.373588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.384944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940559f9-b453-4f02-a7c7-82c723288e1b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.389831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.390521 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.390805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.391081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.391840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.393514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.407106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1105/2219] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:52.408154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.418301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558121a-daed-499e-a957-45448c5f9dfa admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.421268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0798bd9fe1f4d4a8595081941e3f420', 'request_id': 'req-ad395dd0-a6a9-495c-b25e-7ee1642e441f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.429117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0798bd9fe1f4d4a8595081941e3f420', 'request_id': 'req-ad395dd0-a6a9-495c-b25e-7ee1642e441f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.436018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0798bd9fe1f4d4a8595081941e3f420', 'request_id': 'req-ad395dd0-a6a9-495c-b25e-7ee1642e441f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.449304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] The token cache is being invalidate because project f0798bd9fe1f4d4a8595081941e3f420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:52.449592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.450257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.452045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1115/2220] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:52 2022] DELETE /identity/v3/projects/f0798bd9fe1f4d4a8595081941e3f420 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:52.456108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.458092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.488353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71653b9-4e6d-43f0-98da-2accf7c6c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.489463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71653b9-4e6d-43f0-98da-2accf7c6c2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.489779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71653b9-4e6d-43f0-98da-2accf7c6c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.490084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71653b9-4e6d-43f0-98da-2accf7c6c2d8 admin admin] PATH_INFO: `/v3/projects/facf3dcf449b49ee908f6d731447b1da/users/8edc03c402b94e2cb94a65992e24d8eb/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.507040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71653b9-4e6d-43f0-98da-2accf7c6c2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facf3dcf449b49ee908f6d731447b1da, user_id=8edc03c402b94e2cb94a65992e24d8eb, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.510373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71653b9-4e6d-43f0-98da-2accf7c6c2d8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.519860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:52.529469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1106/2221] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:52 2022] PUT /identity/v3/projects/facf3dcf449b49ee908f6d731447b1da/users/8edc03c402b94e2cb94a65992e24d8eb/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:52.531495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.531702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.531927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.542828 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395dd0-a6a9-495c-b25e-7ee1642e441f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.557718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:52.559612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.614791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.615898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.616158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.616438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] PATH_INFO: `/v3/users/097e8b26f3404904b9c816cc259d58d6` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.617873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097e8b26f3404904b9c816cc259d58d6)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.620557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.647259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1107/2222] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:52.657586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:52.659203 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.682467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097e8b26f3404904b9c816cc259d58d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.683166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097e8b26f3404904b9c816cc259d58d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.683810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097e8b26f3404904b9c816cc259d58d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.697812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097e8b26f3404904b9c816cc259d58d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.707228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097e8b26f3404904b9c816cc259d58d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:52.710805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:52.723529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1116/2223] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:52 2022] DELETE /identity/v3/users/097e8b26f3404904b9c816cc259d58d6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:44:52.733202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d75fa-112e-440c-b64e-b0e52dbe5115 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:52.795755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:52.795755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:52.796065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:52.796238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:52.798063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:52.864930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:52.866280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3be9fa-0405-47e9-b719-beca38318715 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:52.882487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1108/2224] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:53.089714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.091487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:53.108529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c288b51-449e-4756-bca5-98e30babdb09 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.114089 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.115196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.115420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.116013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] PATH_INFO: `/v3/projects/96314dd42a6d4606a1e31c241b212f9f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.117869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96314dd42a6d4606a1e31c241b212f9f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.121176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.174551 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96314dd42a6d4606a1e31c241b212f9f', 'request_id': 'req-31d18832-b703-4fb1-87d9-59ff2b1f3d24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:53.182054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96314dd42a6d4606a1e31c241b212f9f', 'request_id': 'req-31d18832-b703-4fb1-87d9-59ff2b1f3d24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:53.188563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96314dd42a6d4606a1e31c241b212f9f', 'request_id': 'req-31d18832-b703-4fb1-87d9-59ff2b1f3d24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:53.197131 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:53.201345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] The token cache is being invalidate because project 96314dd42a6d4606a1e31c241b212f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:53.201947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:53.203627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-31d18832-b703-4fb1-87d9-59ff2b1f3d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:53.205747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1117/2225] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:53 2022] DELETE /identity/v3/projects/96314dd42a6d4606a1e31c241b212f9f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:53.210768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.211329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.211459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.234795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:53.236108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:53.315873 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1109/2226] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:53.323493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.323788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.324124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.354374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:53.356183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:53.367100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1118/2227] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:53.371983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.384449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6635cc6-57df-4dbf-94fd-91d2cdf77f4d None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.389727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.390523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.390875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.391343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.392236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:44:53.392689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.394828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.409249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1110/2228] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:44:53.414009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.425814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19eb31-0c5a-45ef-9316-55da26bb36c0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.431112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.432104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.432306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.432860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.433247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.435419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.469587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1119/2229] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:44:53 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:44:53.470699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.483552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941bfd-45b3-46b9-9285-09565438d32d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.516960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:53.560081 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.560815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.561488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.561488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.562314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.564339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.602129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1111/2230] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:44:53 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:44:53.607939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.619530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acfea3-786a-4b09-870f-7b91b86f1d63 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.625769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813992ff-5cfe-42a7-b618-f12f243e4a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.626517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813992ff-5cfe-42a7-b618-f12f243e4a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.626902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813992ff-5cfe-42a7-b618-f12f243e4a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.627238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813992ff-5cfe-42a7-b618-f12f243e4a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.628068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813992ff-5cfe-42a7-b618-f12f243e4a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.629820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813992ff-5cfe-42a7-b618-f12f243e4a40 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.641955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1120/2231] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:44:53.646743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.662756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e979533-eb7b-4698-a345-9e258fa8fc06 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.669925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.670684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.670972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.671288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.672112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.674388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.691402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.691698 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.691988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.702629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1112/2232] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:53.705198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.724336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab391-3a22-4c62-b949-75a781f387fe admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:53.731657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe43757-b420-4eea-b174-b6266f090962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:53.733585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe43757-b420-4eea-b174-b6266f090962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.733875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe43757-b420-4eea-b174-b6266f090962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.734702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe43757-b420-4eea-b174-b6266f090962 admin admin] PATH_INFO: `/v3/projects/dfe3ed186b5f48548d33cc7dacb508a5/users/7cf787229a09459b96ac48b6ac07fd1c/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.763689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] MFA Rules not processed for user `8edc03c402b94e2cb94a65992e24d8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:53.765366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:53.780679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe43757-b420-4eea-b174-b6266f090962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe3ed186b5f48548d33cc7dacb508a5, user_id=7cf787229a09459b96ac48b6ac07fd1c, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:53.783716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe43757-b420-4eea-b174-b6266f090962 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:53.814763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1113/2233] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:44:53 2022] PUT /identity/v3/projects/dfe3ed186b5f48548d33cc7dacb508a5/users/7cf787229a09459b96ac48b6ac07fd1c/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:53.903066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1121/2234] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:53.903278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:53.903278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:53.903278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:53.913209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:53.915837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:53.938604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] MFA Rules not processed for user `7cf787229a09459b96ac48b6ac07fd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:53.940665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:54.014164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26499f6-3da7-4adf-a38e-69e641d80e50 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:54.026807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1114/2235] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:54.039690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:54.042028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:54.082422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dc834-65a8-4ffc-90e1-81c5508702da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:54.083107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dc834-65a8-4ffc-90e1-81c5508702da service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:54.083856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dc834-65a8-4ffc-90e1-81c5508702da service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:54.083856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dc834-65a8-4ffc-90e1-81c5508702da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:54.117775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:54.126720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a74584-6e3f-4136-8fc7-de8d411c7a59 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:54.131058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:54.131789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:54.132079 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:54.132375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:54.144653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:54.146290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:54.157208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1115/2236] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:54.180510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dc834-65a8-4ffc-90e1-81c5508702da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:54.182493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dc834-65a8-4ffc-90e1-81c5508702da service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:54.184637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:54.192604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1122/2237] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:54.209849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:54.264587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12522a-61fe-403b-89e4-cc5f81e5de9c service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:54.271918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:54.272918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:54.273277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:54.273622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] PATH_INFO: `/v3/users/7cf787229a09459b96ac48b6ac07fd1c` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:54.275316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf787229a09459b96ac48b6ac07fd1c)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:54.277287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:54.350317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf787229a09459b96ac48b6ac07fd1c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:54.351539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf787229a09459b96ac48b6ac07fd1c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:54.352280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf787229a09459b96ac48b6ac07fd1c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:54.369026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf787229a09459b96ac48b6ac07fd1c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:54.381626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf787229a09459b96ac48b6ac07fd1c'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:54.406989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1116/2238] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:44:54 2022] DELETE /identity/v3/users/7cf787229a09459b96ac48b6ac07fd1c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:54.409061 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:54.409466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:54.409823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:54.432983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:54.435022 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:54.512375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1123/2239] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:54.522403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:54.523871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:54.605722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c0aa-db29-4c19-8807-3073d005386c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:54.610481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f24408-12f0-4e4a-a6cf-b9fd4552e905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:54.612334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f24408-12f0-4e4a-a6cf-b9fd4552e905 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:54.612637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f24408-12f0-4e4a-a6cf-b9fd4552e905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:54.612922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f24408-12f0-4e4a-a6cf-b9fd4552e905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:54.623022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f24408-12f0-4e4a-a6cf-b9fd4552e905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:54.624586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f24408-12f0-4e4a-a6cf-b9fd4552e905 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:54.635332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1117/2240] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:44:54.936452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:54.938051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:54.974776 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d695-434e-4991-bd10-02e5e3017964 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:54.981018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:54.982106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:54.982478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:54.982766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] PATH_INFO: `/v3/projects/dfe3ed186b5f48548d33cc7dacb508a5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:54.984114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe3ed186b5f48548d33cc7dacb508a5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:54.986063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:55.048184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe3ed186b5f48548d33cc7dacb508a5', 'request_id': 'req-2108dd62-7517-4fa3-b82c-f2a02e695383'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:55.058532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe3ed186b5f48548d33cc7dacb508a5', 'request_id': 'req-2108dd62-7517-4fa3-b82c-f2a02e695383'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:55.068581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe3ed186b5f48548d33cc7dacb508a5', 'request_id': 'req-2108dd62-7517-4fa3-b82c-f2a02e695383'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:55.081699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] The token cache is being invalidate because project dfe3ed186b5f48548d33cc7dacb508a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:44:55.082272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:55.083002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2108dd62-7517-4fa3-b82c-f2a02e695383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:44:55.084968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1124/2241] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:44:54 2022] DELETE /identity/v3/projects/dfe3ed186b5f48548d33cc7dacb508a5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:44:55.626505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:55.627307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:55.627675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:55.654678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] MFA Rules not processed for user `8edc03c402b94e2cb94a65992e24d8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:55.656013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:55.697261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:55.722093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1118/2242] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:44:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:00.838211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf79e7-9d7e-482f-89ff-279635fce2ad None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:00.838749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf79e7-9d7e-482f-89ff-279635fce2ad None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:00.838844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf79e7-9d7e-482f-89ff-279635fce2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:00.871706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-beaf79e7-9d7e-482f-89ff-279635fce2ad None None] MFA Rules not processed for user `a2fd9d4ef85649c6ba75876e99df4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:00.873215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-beaf79e7-9d7e-482f-89ff-279635fce2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:00.926858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:00.974188 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1125/2243] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:03.857245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:03.859309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:03.952455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba78db-fffa-4dd1-a51c-465d43838cdf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:03.956999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:03.957902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:03.958183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:03.958463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] PATH_INFO: `/v3/users/816fadbb99cd42208a7bb93fd30c3731` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:03.959750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816fadbb99cd42208a7bb93fd30c3731)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:03.961779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:04.022012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816fadbb99cd42208a7bb93fd30c3731'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.022693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816fadbb99cd42208a7bb93fd30c3731'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.023312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816fadbb99cd42208a7bb93fd30c3731'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.038692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816fadbb99cd42208a7bb93fd30c3731'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.048222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816fadbb99cd42208a7bb93fd30c3731'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.064394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1119/2244] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:03 2022] DELETE /identity/v3/users/816fadbb99cd42208a7bb93fd30c3731 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:04.069101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:04.069963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:04.070300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:04.092352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:04.094018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:04.169424 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1126/2245] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:04.177658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:04.178988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:04.292272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b13ba-2243-4d6a-b1b3-16d78d40e439 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:04.298127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:04.298971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:04.299361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:04.299812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:04.312323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:04.315187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:04.326606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1120/2246] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:04.675672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:04.677190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:04.689791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d20db-bed1-4ca4-9992-86efd04f792b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:04.697460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:04.698344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:04.699234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:04.699571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] PATH_INFO: `/v3/projects/8247d561a38c4d3586c66b7dddcdb567` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:04.700826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8247d561a38c4d3586c66b7dddcdb567)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:04.703609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:04.766886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8247d561a38c4d3586c66b7dddcdb567', 'request_id': 'req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.775075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8247d561a38c4d3586c66b7dddcdb567', 'request_id': 'req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.781179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8247d561a38c4d3586c66b7dddcdb567', 'request_id': 'req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.794594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] The token cache is being invalidate because project 8247d561a38c4d3586c66b7dddcdb567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:04.794918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.795637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.797252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1127/2247] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:04 2022] DELETE /identity/v3/projects/8247d561a38c4d3586c66b7dddcdb567 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:04.801314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:04.816919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3bfcf-443a-4b46-9ecb-da3307550aef service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:04.820658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:04.879633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:04.880513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:04.880797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:04.881073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] PATH_INFO: `/v3/users/5ffeed1e44a64bfbad5aa9b4715f5179` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:04.882269 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffeed1e44a64bfbad5aa9b4715f5179)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:04.884265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:04.940924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffeed1e44a64bfbad5aa9b4715f5179'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.940924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffeed1e44a64bfbad5aa9b4715f5179'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.941959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffeed1e44a64bfbad5aa9b4715f5179'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.963035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffeed1e44a64bfbad5aa9b4715f5179'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.964957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:04.966535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:04.972829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5827ec00-68c4-4d51-8e2d-1feeb665e67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffeed1e44a64bfbad5aa9b4715f5179'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:04.984871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9b6a3-415a-4a3b-a02a-f2eb82aaea42 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:04.990221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:04.991046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:04.991326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:04.991629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] PATH_INFO: `/v3/users/b99c1c3a0e724057a21cfcc3a9f310fc` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:04.994315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99c1c3a0e724057a21cfcc3a9f310fc)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:04.996088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1121/2248] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:04 2022] DELETE /identity/v3/users/5ffeed1e44a64bfbad5aa9b4715f5179 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:04.996225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:05.048956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99c1c3a0e724057a21cfcc3a9f310fc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.049635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99c1c3a0e724057a21cfcc3a9f310fc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.050266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99c1c3a0e724057a21cfcc3a9f310fc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.064091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99c1c3a0e724057a21cfcc3a9f310fc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.067916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:05.071882 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99c1c3a0e724057a21cfcc3a9f310fc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.087587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1128/2249] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:04 2022] DELETE /identity/v3/users/b99c1c3a0e724057a21cfcc3a9f310fc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:05.093135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.093455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.093733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.114539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:05.115789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.184684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1122/2250] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:05.197705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:05.199364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.277342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d8f32-beb7-475e-854b-97f1a82da94b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:05.281207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae317-0345-4427-8d97-913326e30da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:05.281981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae317-0345-4427-8d97-913326e30da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.282392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae317-0345-4427-8d97-913326e30da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.282679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae317-0345-4427-8d97-913326e30da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.293082 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae317-0345-4427-8d97-913326e30da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:05.294575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae317-0345-4427-8d97-913326e30da6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:05.304502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1129/2251] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:05.509353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:05.511249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.532268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2dffc-8b7f-4007-8e7c-cea8c0ae3199 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:05.538155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:05.539558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.539558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.540084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] PATH_INFO: `/v3/projects/4da42244d83540c8b86215ac1dfaa915` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.541677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da42244d83540c8b86215ac1dfaa915)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:05.544221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:05.599906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:05.631310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da42244d83540c8b86215ac1dfaa915', 'request_id': 'req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.642245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da42244d83540c8b86215ac1dfaa915', 'request_id': 'req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.652411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da42244d83540c8b86215ac1dfaa915', 'request_id': 'req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.668315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] The token cache is being invalidate because project 4da42244d83540c8b86215ac1dfaa915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:05.668815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.669541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.674366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1123/2252] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:05 2022] DELETE /identity/v3/projects/4da42244d83540c8b86215ac1dfaa915 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:05.676451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3f4c-f62c-4e46-8af6-184726bf0af0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.676753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3f4c-f62c-4e46-8af6-184726bf0af0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.677176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3f4c-f62c-4e46-8af6-184726bf0af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.701840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d0da3f4c-f62c-4e46-8af6-184726bf0af0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:05.702954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d0da3f4c-f62c-4e46-8af6-184726bf0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.729481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:05.731113 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.783871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1130/2253] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:05.791931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.792304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.792653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.810776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f21fbb-bc59-4dbc-9967-e70cc65bf70a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:05.812292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:05.813590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.815778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:05.816731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.817019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.817295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] PATH_INFO: `/v3/projects/40949b339f114d99be43b70cb7fb576e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.818531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40949b339f114d99be43b70cb7fb576e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:05.820502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:05.822238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1131/2254] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:05.826291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:05.836504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712f71-26a8-424f-8f87-e4cb4acd9b54 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:05.842545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:05.843209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.843516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.843794 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.844744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:45:05.844862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:05.846450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:05.865931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1132/2255] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:45:05.868418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:05.877284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40949b339f114d99be43b70cb7fb576e', 'request_id': 'req-f60de6bd-0205-4050-8dc8-463f0bfdff64'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.878739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ce2ed-f221-48f2-9de3-86bf63b0fe63 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:05.886983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40949b339f114d99be43b70cb7fb576e', 'request_id': 'req-f60de6bd-0205-4050-8dc8-463f0bfdff64'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.894390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40949b339f114d99be43b70cb7fb576e', 'request_id': 'req-f60de6bd-0205-4050-8dc8-463f0bfdff64'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.909611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] The token cache is being invalidate because project 40949b339f114d99be43b70cb7fb576e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:05.909898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.910558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f60de6bd-0205-4050-8dc8-463f0bfdff64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:05.912292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1124/2256] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:05 2022] DELETE /identity/v3/projects/40949b339f114d99be43b70cb7fb576e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:05.916953 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeab31-0f98-465f-b482-a13b7b0aacae None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.917351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeab31-0f98-465f-b482-a13b7b0aacae None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.917699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeab31-0f98-465f-b482-a13b7b0aacae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.943935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-20eeab31-0f98-465f-b482-a13b7b0aacae None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:05.945349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-20eeab31-0f98-465f-b482-a13b7b0aacae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:05.954859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:05.955580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:05.955932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:05.956281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:05.957251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:05.959243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:05.983449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:05.996978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:06.009644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1133/2257] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:05 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:06.014735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.017900 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:06.043003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1125/2258] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:06.052744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.053076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.053365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.093836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:06.095188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:06.105607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99459641-e945-44d3-9d67-df0c5bc0f179 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.112099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.113257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1126/2259] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:06.113567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.113919 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.114530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.115277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.117279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.117686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.127694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e97aec-87f0-4651-9dab-a7799c64f21e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.132737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.134130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.134453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.134710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.135487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:45:06.135800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.137675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.143178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1134/2260] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:06.147464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.154493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1127/2261] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:45:06.156091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.158361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff57a-237f-43c6-8d1b-7cadc17d3b04 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.163151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.163918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.164299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.164677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.165904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.167805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.169016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a0ea-33ed-421c-9aa7-665b24246f64 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.174622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.175662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.175874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.176268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.177055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.179108 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1135/2262] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:06.179226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.183218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.193981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468340bf-3c32-400e-bc84-0093ed07413e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.206778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.207422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.207714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.208001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.208754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.210450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.218575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1128/2263] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:45:06.222961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1136/2264] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:06.223644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.229394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.240898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5354-ad7a-4097-abdb-bfbad067e82f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.299795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381cb58-daa9-404b-9346-ad3eef6e2212 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.302427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.303431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.303868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.304207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] PATH_INFO: `/v3/projects/304fbdf31ca740628615e10df2a671de/users/c3175044eeec437d808fd3fde141939a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.310732 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf54dbf-6245-4390-afcb-e11bc16a1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.311439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54dbf-6245-4390-afcb-e11bc16a1e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.311729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54dbf-6245-4390-afcb-e11bc16a1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.312006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54dbf-6245-4390-afcb-e11bc16a1e8d admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.312713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54dbf-6245-4390-afcb-e11bc16a1e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.314641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54dbf-6245-4390-afcb-e11bc16a1e8d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.320849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=304fbdf31ca740628615e10df2a671de, user_id=c3175044eeec437d808fd3fde141939a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.324314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.339138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1129/2265] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:06.340654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1137/2266] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:06 2022] PUT /identity/v3/projects/304fbdf31ca740628615e10df2a671de/users/c3175044eeec437d808fd3fde141939a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:06.344693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.351031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.351333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.351637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.393267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] MFA Rules not processed for user `c3175044eeec437d808fd3fde141939a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:06.394488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:06.400413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:06.418636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78456c8-154d-46fe-97b9-467eae8b9ddc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.423282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.423972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.424259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.424534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.425270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.427215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.436744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1138/2267] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:06.440842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.451496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa11f6-e966-498d-b54a-9808e7c1150f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.456241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.456963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.457184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.457461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.458212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.460224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.469722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1130/2268] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:06.473515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.478606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1139/2269] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:06.479616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.493202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80824ecb-3b3f-43ae-abc7-d8c69a5c19b5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.499988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c18e3-4ee6-4e93-a2a5-d68b026589a8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.501396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.502156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.505826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8f6b7-4806-46eb-969c-414bad2f8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.505955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.506241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.507241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.508078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8f6b7-4806-46eb-969c-414bad2f8cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.509102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8f6b7-4806-46eb-969c-414bad2f8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.509555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8f6b7-4806-46eb-969c-414bad2f8cd7 admin admin] PATH_INFO: `/v3/projects/34a023f053a14c97b29f8945cf0c0772/users/b174788afddf426d8d276fd048f0a88a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.509799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.531508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:06.531744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8f6b7-4806-46eb-969c-414bad2f8cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a023f053a14c97b29f8945cf0c0772, user_id=b174788afddf426d8d276fd048f0a88a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.534902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8f6b7-4806-46eb-969c-414bad2f8cd7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.551715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1131/2270] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:06.555439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.561309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1140/2271] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:06 2022] PUT /identity/v3/projects/34a023f053a14c97b29f8945cf0c0772/users/b174788afddf426d8d276fd048f0a88a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:06.566178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.566544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.566923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.591734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:06.593054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:06.626136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39315f3-35a9-4e76-b1c5-763737edbe68 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.631776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.632582 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.632959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.633241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.634565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.636715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.662138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1141/2272] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:06.662332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1132/2273] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:45:06.668585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.672726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.674979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:06.682954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38edb-d515-45b1-aafa-2f314c6bb6e9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.688441 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.689300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.689956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.690489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.691903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.693682 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.707062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1133/2274] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:06.711014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.723330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb155571-e040-4ed1-94ed-5e6499a4bede admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.728273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.729506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.729677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.729966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] PATH_INFO: `/v3/projects/0a5b4dc9290a40168850c827db64b6bd/users/737206f1bbd94a96b9dd6c269b08f014/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.745691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5b4dc9290a40168850c827db64b6bd, user_id=737206f1bbd94a96b9dd6c269b08f014, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.748508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.749394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b714c5a-6c83-4a4e-8ef6-8e5519484bc9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.754229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.754929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.755218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.755528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.763188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1134/2275] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:06 2022] PUT /identity/v3/projects/0a5b4dc9290a40168850c827db64b6bd/users/737206f1bbd94a96b9dd6c269b08f014/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:06.767066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.769300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.772739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.784918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1142/2276] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:06.832339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6f881-906b-4ee2-8739-86d79073c510 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.837419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93817-a8ac-4a05-a121-4489ae22ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.838120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93817-a8ac-4a05-a121-4489ae22ae61 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.838414 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93817-a8ac-4a05-a121-4489ae22ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.838698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93817-a8ac-4a05-a121-4489ae22ae61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.839561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93817-a8ac-4a05-a121-4489ae22ae61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.841147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93817-a8ac-4a05-a121-4489ae22ae61 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.852262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1135/2277] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:06.856356 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:06.866558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d5f8-4e8a-424a-a4aa-17ef47289c6f service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:06.872144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:06.873021 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.873308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.873621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] PATH_INFO: `/v3/projects/0a5b4dc9290a40168850c827db64b6bd/users/737206f1bbd94a96b9dd6c269b08f014/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.875662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5b4dc9290a40168850c827db64b6bd, user_id=737206f1bbd94a96b9dd6c269b08f014, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:06.878382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:06.890481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1143/2278] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:06 2022] PUT /identity/v3/projects/0a5b4dc9290a40168850c827db64b6bd/users/737206f1bbd94a96b9dd6c269b08f014/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:06.901975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f91c-f986-4557-87a6-467d39f1f462 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:06.902478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f91c-f986-4557-87a6-467d39f1f462 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:06.902836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f91c-f986-4557-87a6-467d39f1f462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:06.932779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6d31f91c-f986-4557-87a6-467d39f1f462 None None] MFA Rules not processed for user `737206f1bbd94a96b9dd6c269b08f014`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:06.934294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6d31f91c-f986-4557-87a6-467d39f1f462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:06.990182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:07.038963 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1136/2279] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:07.052340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:07.054251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:07.101793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:07.130361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318341-3ec8-49b0-8e65-b9ecabbcc6d7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:07.134747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:07.137143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:07.137498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:07.139799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:07.150029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:07.151635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:07.173557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1144/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:07.511495 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:07.512102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:07.512365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:07.562552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] MFA Rules not processed for user `b174788afddf426d8d276fd048f0a88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:07.564221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:07.683121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1137/2281] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:07.698997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:07.700831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:07.713634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c2ef4-2548-4de4-97f8-0bb26b7a5a24 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:07.717654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b05a9-310d-4c1c-9078-e8be8121a432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:07.718310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b05a9-310d-4c1c-9078-e8be8121a432 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:07.718593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b05a9-310d-4c1c-9078-e8be8121a432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:07.718869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b05a9-310d-4c1c-9078-e8be8121a432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:07.728330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b05a9-310d-4c1c-9078-e8be8121a432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:07.729808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b05a9-310d-4c1c-9078-e8be8121a432 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:07.740597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1145/2282] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:09.268639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:09.327286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabe9b2-03b8-482d-9ad0-7bbe1286d549 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:09.327834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabe9b2-03b8-482d-9ad0-7bbe1286d549 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:09.327935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabe9b2-03b8-482d-9ad0-7bbe1286d549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:09.349103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0dabe9b2-03b8-482d-9ad0-7bbe1286d549 None None] MFA Rules not processed for user `b174788afddf426d8d276fd048f0a88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:09.350507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0dabe9b2-03b8-482d-9ad0-7bbe1286d549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:09.358417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fbca2-fdfb-4876-adf6-3346c37a8a72 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:09.360473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1146/2283] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:09.364933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:09.365560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:09.365905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:09.366195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] PATH_INFO: `/v3/users/c3175044eeec437d808fd3fde141939a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:09.367580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3175044eeec437d808fd3fde141939a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:09.370095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:09.464918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3175044eeec437d808fd3fde141939a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:09.465824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3175044eeec437d808fd3fde141939a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:09.466827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3175044eeec437d808fd3fde141939a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:09.484641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:09.485901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3175044eeec437d808fd3fde141939a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:09.503122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3175044eeec437d808fd3fde141939a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:09.526533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1138/2284] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:09 2022] DELETE /identity/v3/users/c3175044eeec437d808fd3fde141939a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:09.534770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:09.535376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:09.535844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:09.561626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:09.563621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:09.644632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1147/2285] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:09.660050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:09.663876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:09.822458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6d4c2-d024-48cf-b784-c22bcc96c370 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:09.833410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:09.834222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:09.834605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:09.834996 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:09.860268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:09.861972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:09.883150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1139/2286] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:10.295198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:10.296737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:10.314588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935313-e6ad-476f-ab22-06cab4034600 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:10.320042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:10.321950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:10.322306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:10.322657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] PATH_INFO: `/v3/projects/304fbdf31ca740628615e10df2a671de` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:10.323962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304fbdf31ca740628615e10df2a671de)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:10.325960 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:10.390321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304fbdf31ca740628615e10df2a671de', 'request_id': 'req-69512d50-1b87-40d8-a8af-a9fa94a25b30'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.404709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304fbdf31ca740628615e10df2a671de', 'request_id': 'req-69512d50-1b87-40d8-a8af-a9fa94a25b30'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.412080 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304fbdf31ca740628615e10df2a671de', 'request_id': 'req-69512d50-1b87-40d8-a8af-a9fa94a25b30'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.425609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] The token cache is being invalidate because project 304fbdf31ca740628615e10df2a671de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:10.425896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.426542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.428104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1148/2287] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:10 2022] DELETE /identity/v3/projects/304fbdf31ca740628615e10df2a671de => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:10.432447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:10.442572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e95cf-1be7-4a47-9d29-33f2be894418 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:10.504877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:10.505762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:10.506048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:10.506329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] PATH_INFO: `/v3/users/737206f1bbd94a96b9dd6c269b08f014` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:10.507590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737206f1bbd94a96b9dd6c269b08f014)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:10.510791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:10.566250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737206f1bbd94a96b9dd6c269b08f014'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.566895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737206f1bbd94a96b9dd6c269b08f014'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.567520 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737206f1bbd94a96b9dd6c269b08f014'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.579568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737206f1bbd94a96b9dd6c269b08f014'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.586361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-35358432-edb6-436e-8421-273cbefb83b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737206f1bbd94a96b9dd6c269b08f014'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:10.599028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1140/2288] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:10 2022] DELETE /identity/v3/users/737206f1bbd94a96b9dd6c269b08f014 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:10.870493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:10.871963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:10.886167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69512d50-1b87-40d8-a8af-a9fa94a25b30 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:10.927471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:10.945417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:10.946357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:10.946647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:10.946928 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] PATH_INFO: `/v3/projects/0a5b4dc9290a40168850c827db64b6bd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:10.948141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5b4dc9290a40168850c827db64b6bd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:10.950106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:10.996619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5b4dc9290a40168850c827db64b6bd', 'request_id': 'req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:11.003800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5b4dc9290a40168850c827db64b6bd', 'request_id': 'req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:11.009301 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5b4dc9290a40168850c827db64b6bd', 'request_id': 'req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:11.020241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] The token cache is being invalidate because project 0a5b4dc9290a40168850c827db64b6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:11.020524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:11.021137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2584a8af-b9e3-4f7b-bf35-4ecb7f83980a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:11.022648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1149/2289] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:10 2022] DELETE /identity/v3/projects/0a5b4dc9290a40168850c827db64b6bd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:11.027611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.027909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.028198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.036025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:11.050690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:11.051882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:11.113743 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1141/2290] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:11.121735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.122024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.122299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.141712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:11.142916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:11.151569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1150/2291] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:11.155586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.165596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314e15a-1483-4341-a0c5-a68d4c779721 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.170605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.171337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.171677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.171928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.172723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:45:11.173033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.174614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.187293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1142/2292] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:45:11.191557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.200838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfd621-df4b-40fd-b6db-864ef4e824cf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.205642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.206294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.206570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.206842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.207575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.209476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.262211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1151/2293] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:11.266002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.276929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395efc-a0e5-4276-9d18-4553c615a34e admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.351888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.353135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.353419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.353697 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.354405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.356405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.385463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1143/2294] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:45:11.389772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.406168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89610b8-9af7-42cd-83d5-384901a864ea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.410989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.411808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.412162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.412508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.413319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.416109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.427419 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1152/2295] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:11.430752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.441115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a52538-6153-40c9-b928-3d7756dd5fa6 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.446401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fa35-e9c5-444f-a0cd-d19ce48c01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.447065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fa35-e9c5-444f-a0cd-d19ce48c01ff admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.447352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fa35-e9c5-444f-a0cd-d19ce48c01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.447663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fa35-e9c5-444f-a0cd-d19ce48c01ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.448396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4fa35-e9c5-444f-a0cd-d19ce48c01ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.450358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4fa35-e9c5-444f-a0cd-d19ce48c01ff admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.462085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1144/2296] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:11.466177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.476591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb40f6b-279c-41fa-a7a2-90741228ee73 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.496050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.498030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.498411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.498760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] PATH_INFO: `/v3/projects/00c62166a1c046c49d33f2afa9707579/users/1e9580fd3026462f97350be903aaf90a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.519113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c62166a1c046c49d33f2afa9707579, user_id=1e9580fd3026462f97350be903aaf90a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.522049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.544585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1153/2297] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:11 2022] PUT /identity/v3/projects/00c62166a1c046c49d33f2afa9707579/users/1e9580fd3026462f97350be903aaf90a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:11.557671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.557922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.558169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.592385 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] MFA Rules not processed for user `1e9580fd3026462f97350be903aaf90a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:11.593640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:11.672254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:11.682933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1145/2298] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:11.683854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.745536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c0f1-68ca-492e-afb2-ccc028f48ff5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.750234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.750896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.751184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.751499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.752201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.754125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.769245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:11.783249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1154/2299] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:45:11.787120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.797722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b79b7-f8d5-4c0e-a16a-090fc701929f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.854531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.855127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.855448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.855735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.856463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.858428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.880146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1146/2300] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:11 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:11.884561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.895037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba80754-8fc1-44d4-9df8-804310f31dbc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.900239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.902153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.903323 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.903671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.904670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.906293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:11.930690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1155/2301] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:11.934859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:11.951057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68506e26-843b-4d7e-91e6-d801535e0745 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:11.956030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:11.956927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:11.957219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:11.957497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] PATH_INFO: `/v3/projects/10ea00d273bd4b23ae4ee5b416c8402e/users/d653c4401ec443ecbedd4181785826a7/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:11.980126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ea00d273bd4b23ae4ee5b416c8402e, user_id=d653c4401ec443ecbedd4181785826a7, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:11.982962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:12.007573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1147/2302] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:11 2022] PUT /identity/v3/projects/10ea00d273bd4b23ae4ee5b416c8402e/users/d653c4401ec443ecbedd4181785826a7/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:12.012699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:12.025574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509608-46d2-4634-85d8-ac5f920692ad admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:12.111700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3bbf3-6173-4088-809d-a865804e1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:12.112368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3bbf3-6173-4088-809d-a865804e1616 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:12.112719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3bbf3-6173-4088-809d-a865804e1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:12.113060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3bbf3-6173-4088-809d-a865804e1616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:12.114494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3bbf3-6173-4088-809d-a865804e1616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:12.117114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3bbf3-6173-4088-809d-a865804e1616 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:12.133264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1156/2303] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:12.137901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:12.149537 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b2578-935f-4cf4-8855-eb24bc92eb9c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:12.155860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:12.156922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:12.157198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:12.157479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] PATH_INFO: `/v3/projects/10ea00d273bd4b23ae4ee5b416c8402e/users/d653c4401ec443ecbedd4181785826a7/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:12.159642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ea00d273bd4b23ae4ee5b416c8402e, user_id=d653c4401ec443ecbedd4181785826a7, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:12.162422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:12.175534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1148/2304] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:12 2022] PUT /identity/v3/projects/10ea00d273bd4b23ae4ee5b416c8402e/users/d653c4401ec443ecbedd4181785826a7/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:12.185394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:12.185843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:12.186194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:12.215010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] MFA Rules not processed for user `d653c4401ec443ecbedd4181785826a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:12.216416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:12.293920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1157/2305] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:12.306440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:12.308171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:12.405754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8fcb-54f9-429a-aa36-f445c1ec32c1 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:12.409838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa53bf0-e07a-4d58-a4a1-73232e8b5bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:12.410516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53bf0-e07a-4d58-a4a1-73232e8b5bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:12.411223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53bf0-e07a-4d58-a4a1-73232e8b5bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:12.411223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53bf0-e07a-4d58-a4a1-73232e8b5bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:12.437811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa53bf0-e07a-4d58-a4a1-73232e8b5bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:12.438958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa53bf0-e07a-4d58-a4a1-73232e8b5bb7 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:12.452534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1149/2306] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:45:12.581712 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:12.603916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2778b-4617-40c4-a73a-d219085ac852 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:12.607937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e66d7-7bea-4024-9fcd-5e28670318d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:12.608708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e66d7-7bea-4024-9fcd-5e28670318d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:12.609003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e66d7-7bea-4024-9fcd-5e28670318d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:12.609287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e66d7-7bea-4024-9fcd-5e28670318d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:12.680087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e66d7-7bea-4024-9fcd-5e28670318d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:12.681621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e66d7-7bea-4024-9fcd-5e28670318d6 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:12.692391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1158/2307] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:14.979228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:14.979849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:14.979849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:14.999969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] MFA Rules not processed for user `8edc03c402b94e2cb94a65992e24d8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:15.001198 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:15.052349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:15.068551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1150/2308] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:15.249597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a197428-3374-4080-9fa6-f358b58e164a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:15.251068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a197428-3374-4080-9fa6-f358b58e164a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:15.251243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a197428-3374-4080-9fa6-f358b58e164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:15.258589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:15.273097 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0a197428-3374-4080-9fa6-f358b58e164a None None] MFA Rules not processed for user `d9d24a461bf543148b3c0e45a9d2006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:15.275192 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0a197428-3374-4080-9fa6-f358b58e164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:15.340772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:15.350503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1159/2309] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:15.443982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557281-fcaa-496f-ac3b-13dccdbb4f73 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:15.449241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:15.450503 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:15.451010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:15.451563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] PATH_INFO: `/v3/users/1e9580fd3026462f97350be903aaf90a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:15.454118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9580fd3026462f97350be903aaf90a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:15.456699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:15.535086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9580fd3026462f97350be903aaf90a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:15.537204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9580fd3026462f97350be903aaf90a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:15.537618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9580fd3026462f97350be903aaf90a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:15.564568 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9580fd3026462f97350be903aaf90a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:15.572593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9580fd3026462f97350be903aaf90a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:15.590555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1151/2310] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:15 2022] DELETE /identity/v3/users/1e9580fd3026462f97350be903aaf90a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:15.595013 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:15.595796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:15.596163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:15.616375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:15.617761 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:15.694275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1160/2311] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:15.718733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:15.720362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:15.790578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0acaa-9c1a-4d50-a199-f985c85a9e7c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:15.794598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:15.795349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:15.795745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:15.796097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:15.806755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:15.808379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:15.820903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1152/2312] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:16.773738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:16.775252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:16.801704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70484f-f775-4ac3-bc13-83321f220b67 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:16.835865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:16.838992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:16.839418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:16.839677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] PATH_INFO: `/v3/projects/00c62166a1c046c49d33f2afa9707579` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:16.842465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c62166a1c046c49d33f2afa9707579)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:16.849170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:16.996008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c62166a1c046c49d33f2afa9707579', 'request_id': 'req-6b313f80-b658-4cb3-b490-d18a3f503923'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.024947 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c62166a1c046c49d33f2afa9707579', 'request_id': 'req-6b313f80-b658-4cb3-b490-d18a3f503923'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.033748 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c62166a1c046c49d33f2afa9707579', 'request_id': 'req-6b313f80-b658-4cb3-b490-d18a3f503923'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.049886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] The token cache is being invalidate because project 00c62166a1c046c49d33f2afa9707579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:17.050256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.050846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.052668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1161/2313] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:16 2022] DELETE /identity/v3/projects/00c62166a1c046c49d33f2afa9707579 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:17.058153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:17.073940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152ec5-1437-49a1-ab67-6f14394384d3 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:17.112227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:17.204871 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:17.206155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:17.206487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:17.207242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] PATH_INFO: `/v3/users/d653c4401ec443ecbedd4181785826a7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:17.209619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d653c4401ec443ecbedd4181785826a7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:17.213071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:17.343630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd653c4401ec443ecbedd4181785826a7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.344325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd653c4401ec443ecbedd4181785826a7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.345152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd653c4401ec443ecbedd4181785826a7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.380931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd653c4401ec443ecbedd4181785826a7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.393373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-181c3854-09e7-4f28-80f7-9ccdbbb13408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd653c4401ec443ecbedd4181785826a7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.431661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1153/2314] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:17 2022] DELETE /identity/v3/users/d653c4401ec443ecbedd4181785826a7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:17.799912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:17.801872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:17.816784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b313f80-b658-4cb3-b490-d18a3f503923 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:17.854548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:17.900749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:17.901892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:17.902365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:17.902787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] PATH_INFO: `/v3/projects/10ea00d273bd4b23ae4ee5b416c8402e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:17.904162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ea00d273bd4b23ae4ee5b416c8402e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:17.906378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:17.961689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ea00d273bd4b23ae4ee5b416c8402e', 'request_id': 'req-0217fe0b-9230-42e2-8d9f-25049c16b2fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.980856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ea00d273bd4b23ae4ee5b416c8402e', 'request_id': 'req-0217fe0b-9230-42e2-8d9f-25049c16b2fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:17.988410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ea00d273bd4b23ae4ee5b416c8402e', 'request_id': 'req-0217fe0b-9230-42e2-8d9f-25049c16b2fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:18.000174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] The token cache is being invalidate because project 10ea00d273bd4b23ae4ee5b416c8402e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:18.000460 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:18.001105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0217fe0b-9230-42e2-8d9f-25049c16b2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:18.002634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1162/2315] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:17 2022] DELETE /identity/v3/projects/10ea00d273bd4b23ae4ee5b416c8402e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:18.007290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.007608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.007883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.027989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:18.029209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:18.119560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1154/2316] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:18.126683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.127739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.128045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.164014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:18.165344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:18.182621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1163/2317] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:18.183293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.195513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd8b26-1eae-43d7-b467-d858b014d344 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.202856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.203851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.204132 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.204405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.205140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:45:18.205459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.207070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.220336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1155/2318] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:45:18.224675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.234630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0691cbb-ef2f-4f68-85a1-f25502c1a5f4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.239218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.240037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.240320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.240593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.241313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.243838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.276033 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1164/2319] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:18.278016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.288770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230ce08-2d11-40bc-9fbe-52726fbace9d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.319179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:18.362804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.364012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.364604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.365259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.366154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.369581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.396900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1156/2320] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:18.398434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.410792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8d0f-5adc-47d3-a7ba-5d7c791817c5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.418843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.419565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.419846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.420277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.421052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.422704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.436827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1165/2321] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:18.438045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.449611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffe988-fecb-4db4-9c5d-eee7e5bba30b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.454693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1dee-c721-4866-aeeb-2fb19d6a4282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.455379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1dee-c721-4866-aeeb-2fb19d6a4282 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.455856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1dee-c721-4866-aeeb-2fb19d6a4282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.456143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1dee-c721-4866-aeeb-2fb19d6a4282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.456888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1dee-c721-4866-aeeb-2fb19d6a4282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.458515 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1dee-c721-4866-aeeb-2fb19d6a4282 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.470663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1157/2322] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:18.474990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.487315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185d78-df9d-4ee6-abb3-e826cfcc6859 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.493104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.494423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.494774 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.495161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] PATH_INFO: `/v3/projects/45301c5e5bd848b697ada770f8580063/users/e5c60bcae171429cb43ee3604da4d4d8/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.529464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45301c5e5bd848b697ada770f8580063, user_id=e5c60bcae171429cb43ee3604da4d4d8, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.532664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.561278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1166/2323] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:18 2022] PUT /identity/v3/projects/45301c5e5bd848b697ada770f8580063/users/e5c60bcae171429cb43ee3604da4d4d8/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:18.572630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.572925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.573643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.607218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] MFA Rules not processed for user `e5c60bcae171429cb43ee3604da4d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:18.608513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:18.680541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1158/2324] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:18.685156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.746836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:18.752042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578038a4-5621-479d-9060-7540f7837c87 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.757866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.758887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.759353 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.759848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.760562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.762664 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.820164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1167/2325] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:18.821390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.840393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fdff-bd27-4492-94e3-b27ca3868892 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:18.927883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:18.928768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:18.929058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:18.929346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:18.930262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:18.932223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:18.982131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1159/2326] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:18 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:18.984405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:18.998542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebab12-bc18-4d68-b765-24b017c75836 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:19.004209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:19.004896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.005178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.005618 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.006758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:19.009420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:19.028514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1168/2327] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:19.032909 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:19.049206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30fe8-41ba-4d84-b126-be9596b0e608 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:19.056347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:19.057469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.057925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.058341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] PATH_INFO: `/v3/projects/3aec4ee1dc1d4e278127538bfe6a1412/users/aff79aba2d50476a90137417e02d000e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.081088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aec4ee1dc1d4e278127538bfe6a1412, user_id=aff79aba2d50476a90137417e02d000e, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:19.084026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:19.095531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:19.102708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1160/2328] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:19 2022] PUT /identity/v3/projects/3aec4ee1dc1d4e278127538bfe6a1412/users/aff79aba2d50476a90137417e02d000e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:45:19.115039 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:19.126734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb89e-69e5-4224-b9de-54bcd9329b94 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:19.185798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d178-3a1c-44c1-8fa6-82f45d101dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:19.186473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d178-3a1c-44c1-8fa6-82f45d101dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.186802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d178-3a1c-44c1-8fa6-82f45d101dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.187094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d178-3a1c-44c1-8fa6-82f45d101dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.187856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0d178-3a1c-44c1-8fa6-82f45d101dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:19.189502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0d178-3a1c-44c1-8fa6-82f45d101dc6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:19.200632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1169/2329] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:45:19.204468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:19.218435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25beb34-5e63-4da9-bbc8-22076d7fe1c8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:19.223213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:19.224182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.224463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.224759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] PATH_INFO: `/v3/projects/3aec4ee1dc1d4e278127538bfe6a1412/users/aff79aba2d50476a90137417e02d000e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.227058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aec4ee1dc1d4e278127538bfe6a1412, user_id=aff79aba2d50476a90137417e02d000e, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:19.229721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:19.241123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1161/2330] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:19 2022] PUT /identity/v3/projects/3aec4ee1dc1d4e278127538bfe6a1412/users/aff79aba2d50476a90137417e02d000e/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:19.252479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.252795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.253042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.300165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] MFA Rules not processed for user `aff79aba2d50476a90137417e02d000e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:19.301522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:19.425464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1170/2331] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:19.437078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:19.439623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:19.517356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bdc2-a83b-491e-b549-b7e8743c492a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:19.522885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7293c45-f2e0-4132-896a-49a6e1e16ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:19.523742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293c45-f2e0-4132-896a-49a6e1e16ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.529798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293c45-f2e0-4132-896a-49a6e1e16ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.529798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293c45-f2e0-4132-896a-49a6e1e16ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.543759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7293c45-f2e0-4132-896a-49a6e1e16ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:19.545889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7293c45-f2e0-4132-896a-49a6e1e16ac0 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:19.562129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1162/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:19.734898 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:19.809848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:19.824046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23740436-fc74-4314-a7dd-636518c79af7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:19.834798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:19.835905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.836217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.836502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] PATH_INFO: `/v3/users/e5c60bcae171429cb43ee3604da4d4d8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.838555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c60bcae171429cb43ee3604da4d4d8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:19.840676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:19.897045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c60bcae171429cb43ee3604da4d4d8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:19.897739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c60bcae171429cb43ee3604da4d4d8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:19.898348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c60bcae171429cb43ee3604da4d4d8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:19.913030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c60bcae171429cb43ee3604da4d4d8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:19.923025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c60bcae171429cb43ee3604da4d4d8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:19.942494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1171/2333] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:19 2022] DELETE /identity/v3/users/e5c60bcae171429cb43ee3604da4d4d8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:19.948830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:19.949351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:19.949968 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:19.977534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:19.979026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:20.057764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1163/2334] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:20.072927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:20.074984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:20.184257 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055fdbc-d594-4af0-9027-b765edaeba1c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:20.191665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:20.192459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:20.192818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:20.193276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:20.204406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:20.205956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:20.218218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1172/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:21.128783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:21.130360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:21.145326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18970f-9590-4f83-9ff3-adb83225369e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:21.151221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:21.154218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:21.155057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:21.156032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] PATH_INFO: `/v3/projects/45301c5e5bd848b697ada770f8580063` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:21.159148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45301c5e5bd848b697ada770f8580063)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:21.163678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:21.252595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45301c5e5bd848b697ada770f8580063', 'request_id': 'req-482d001d-d71c-4eba-9866-76c7bda7e177'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.266322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45301c5e5bd848b697ada770f8580063', 'request_id': 'req-482d001d-d71c-4eba-9866-76c7bda7e177'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.284396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45301c5e5bd848b697ada770f8580063', 'request_id': 'req-482d001d-d71c-4eba-9866-76c7bda7e177'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.301545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] The token cache is being invalidate because project 45301c5e5bd848b697ada770f8580063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:21.302092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.303112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.308266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1164/2336] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:21 2022] DELETE /identity/v3/projects/45301c5e5bd848b697ada770f8580063 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:21.312101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:21.322619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1eb6-97db-4d5d-8c93-c0a2e9cfe58c service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:21.401926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:21.402839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:21.403156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:21.403455 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] PATH_INFO: `/v3/users/aff79aba2d50476a90137417e02d000e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:21.404797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff79aba2d50476a90137417e02d000e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:21.406744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:21.423432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:21.465398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff79aba2d50476a90137417e02d000e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.466057 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff79aba2d50476a90137417e02d000e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.466733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff79aba2d50476a90137417e02d000e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.482561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff79aba2d50476a90137417e02d000e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.493332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a5556301-bf5c-4d7f-af84-f0617f378555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff79aba2d50476a90137417e02d000e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:21.511238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1173/2337] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:21 2022] DELETE /identity/v3/users/aff79aba2d50476a90137417e02d000e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:22.198931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.200953 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:22.230693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d001d-d71c-4eba-9866-76c7bda7e177 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.250498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:22.340469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.341392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.341681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.341960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] PATH_INFO: `/v3/projects/3aec4ee1dc1d4e278127538bfe6a1412` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.343647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aec4ee1dc1d4e278127538bfe6a1412)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.345639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.396675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aec4ee1dc1d4e278127538bfe6a1412', 'request_id': 'req-a42812b0-5847-4d95-b249-00e442396a6b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:22.406573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aec4ee1dc1d4e278127538bfe6a1412', 'request_id': 'req-a42812b0-5847-4d95-b249-00e442396a6b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:22.412647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aec4ee1dc1d4e278127538bfe6a1412', 'request_id': 'req-a42812b0-5847-4d95-b249-00e442396a6b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:22.424658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] The token cache is being invalidate because project 3aec4ee1dc1d4e278127538bfe6a1412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:22.424949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:22.425603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a42812b0-5847-4d95-b249-00e442396a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:22.427171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1165/2338] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:22 2022] DELETE /identity/v3/projects/3aec4ee1dc1d4e278127538bfe6a1412 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:22.432163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.432648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.432753 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.452516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:22.453732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:22.512808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1174/2339] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:22.520565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f614-4412-4494-8185-b767594407da None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.520862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f614-4412-4494-8185-b767594407da None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.521164 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f614-4412-4494-8185-b767594407da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.542252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2787f614-4412-4494-8185-b767594407da None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:22.543505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2787f614-4412-4494-8185-b767594407da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:22.551501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1166/2340] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:22.555759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.565584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a9908-c7e5-4461-a916-645d7dbbd69f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.570111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.570797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.571085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.571359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.572145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:45:22.572452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.574064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.585725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1175/2341] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:45:22.590211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787f614-4412-4494-8185-b767594407da None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.599599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787f614-4412-4494-8185-b767594407da None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.605101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.605751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.606036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.606319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.607049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.608987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.635190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1167/2342] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:45:22 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:22.639142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.649703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4cf08-0c9a-477f-8f9c-8e0d0ba8b945 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.707829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.708488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.708771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.709043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.709721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.712295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.733815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1176/2343] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:45:22 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:45:22.737884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.748265 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98a0c6-611f-4d01-a787-8f686e7d1001 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.752961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.753639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.753921 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.754204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.754942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.756593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.767901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1168/2344] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:22.771945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.782561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f8af-5588-403c-b9e8-b02f293f4865 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.787200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2a2a-bf03-4464-a875-4cb3ec704c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.787896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2a2a-bf03-4464-a875-4cb3ec704c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.788213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2a2a-bf03-4464-a875-4cb3ec704c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.788524 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2a2a-bf03-4464-a875-4cb3ec704c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.789272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2a2a-bf03-4464-a875-4cb3ec704c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.790926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2a2a-bf03-4464-a875-4cb3ec704c93 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.796184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:22.802570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1177/2345] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:45:22.806751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:22.816565 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2144a70-4962-4f94-9e59-021fe002824b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:22.821713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:22.822600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.822884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.823186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] PATH_INFO: `/v3/projects/102b0374cc0f4db3b4c9affc454807a8/users/450399b6d30b406ea9a6e297b50f5bfe/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.839031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102b0374cc0f4db3b4c9affc454807a8, user_id=450399b6d30b406ea9a6e297b50f5bfe, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:22.841708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:22.875180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1169/2346] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:45:22 2022] PUT /identity/v3/projects/102b0374cc0f4db3b4c9affc454807a8/users/450399b6d30b406ea9a6e297b50f5bfe/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:22.887239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:22.887563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:22.887839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:22.921575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] MFA Rules not processed for user `450399b6d30b406ea9a6e297b50f5bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:22.922821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:23.000975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1178/2347] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:23.012438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:23.015075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:23.066784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:23.087928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71704-4679-4bd8-866f-4da46b8dbfd5 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:23.092211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbafbd-a517-4564-a865-5ad802edad66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:23.093304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbafbd-a517-4564-a865-5ad802edad66 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:23.093661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbafbd-a517-4564-a865-5ad802edad66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:23.094021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbafbd-a517-4564-a865-5ad802edad66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:23.104659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbafbd-a517-4564-a865-5ad802edad66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:23.106331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbafbd-a517-4564-a865-5ad802edad66 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:23.119658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1170/2348] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:28.602386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:28.669250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf54efc-027f-4bae-ae1e-8cff7ab3a76c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:28.673815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:28.674719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:28.674987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:28.675269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] PATH_INFO: `/v3/users/450399b6d30b406ea9a6e297b50f5bfe` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:28.676506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450399b6d30b406ea9a6e297b50f5bfe)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:28.678439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:28.724345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450399b6d30b406ea9a6e297b50f5bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:28.725364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450399b6d30b406ea9a6e297b50f5bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:28.725986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450399b6d30b406ea9a6e297b50f5bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:28.741119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450399b6d30b406ea9a6e297b50f5bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:28.750005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450399b6d30b406ea9a6e297b50f5bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:28.762818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1179/2349] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:28 2022] DELETE /identity/v3/users/450399b6d30b406ea9a6e297b50f5bfe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:28.767381 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:28.767981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:28.768089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:28.786684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:28.787930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:28.847069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1171/2350] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:28.858307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:28.860219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:28.873328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:28.930334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa270f-1f44-4b33-b234-b48c2430d711 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:28.934044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcf0de-6123-4bbb-86fe-71a33e01eaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:28.934692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf0de-6123-4bbb-86fe-71a33e01eaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:28.934975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf0de-6123-4bbb-86fe-71a33e01eaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:28.935248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf0de-6123-4bbb-86fe-71a33e01eaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:28.944370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcf0de-6123-4bbb-86fe-71a33e01eaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:28.945807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcf0de-6123-4bbb-86fe-71a33e01eaf7 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:28.955964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1180/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:29.356994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:29.361057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:29.374927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23912440-bfdf-4766-9ae8-81b35508106e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:29.380050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:29.380719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:29.380998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:29.381301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] PATH_INFO: `/v3/projects/102b0374cc0f4db3b4c9affc454807a8` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:29.382534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102b0374cc0f4db3b4c9affc454807a8)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:29.385187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:29.437052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102b0374cc0f4db3b4c9affc454807a8', 'request_id': 'req-dbb6648b-e48d-427e-9b27-d44c04000a10'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:29.445137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102b0374cc0f4db3b4c9affc454807a8', 'request_id': 'req-dbb6648b-e48d-427e-9b27-d44c04000a10'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:29.451602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102b0374cc0f4db3b4c9affc454807a8', 'request_id': 'req-dbb6648b-e48d-427e-9b27-d44c04000a10'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:29.466998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] The token cache is being invalidate because project 102b0374cc0f4db3b4c9affc454807a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:29.467319 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:29.468028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:29.469820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1172/2352] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:29 2022] DELETE /identity/v3/projects/102b0374cc0f4db3b4c9affc454807a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:30.507832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483818e-00b4-4fc5-80d0-54d3c85db67e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:30.508378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483818e-00b4-4fc5-80d0-54d3c85db67e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:30.508378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483818e-00b4-4fc5-80d0-54d3c85db67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:30.541583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6483818e-00b4-4fc5-80d0-54d3c85db67e None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:30.542822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6483818e-00b4-4fc5-80d0-54d3c85db67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:30.658084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1181/2353] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:30.731183 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:30.733343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:30.836112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6648b-e48d-427e-9b27-d44c04000a10 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:30.841683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:30.842338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:30.842618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:30.842891 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:30.850394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:30.853639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:30.857338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:30.876476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1173/2354] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:45:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:45:39.776651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd72a4-3c00-4f4f-95f2-eb6c946f3cbe None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:39.777249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd72a4-3c00-4f4f-95f2-eb6c946f3cbe None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:39.777249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd72a4-3c00-4f4f-95f2-eb6c946f3cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:39.798693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d1bd72a4-3c00-4f4f-95f2-eb6c946f3cbe None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:39.800441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d1bd72a4-3c00-4f4f-95f2-eb6c946f3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:39.808037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1182/2355] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:45:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:39.824749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:39.837715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111a3d-1160-4ad1-84e7-9566cf76b354 service swift] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:39.844386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84f5fb-d7df-489e-9b4c-605574989e3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:39.845482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f5fb-d7df-489e-9b4c-605574989e3c service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:39.845482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f5fb-d7df-489e-9b4c-605574989e3c service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:39.845703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f5fb-d7df-489e-9b4c-605574989e3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:39.856845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84f5fb-d7df-489e-9b4c-605574989e3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:39.858942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84f5fb-d7df-489e-9b4c-605574989e3c service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:39.870159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1174/2356] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:45:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:45:46.126065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c8d79-bca0-4a96-ad55-b22f790d1806 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.126981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c8d79-bca0-4a96-ad55-b22f790d1806 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.127522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c8d79-bca0-4a96-ad55-b22f790d1806 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.129081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1183/2357] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:45:46.136808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d8ea-58c5-454f-8578-a64c17424a2a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.137396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d8ea-58c5-454f-8578-a64c17424a2a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.137396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d8ea-58c5-454f-8578-a64c17424a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.161828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-bdc4d8ea-58c5-454f-8578-a64c17424a2a None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:46.163326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bdc4d8ea-58c5-454f-8578-a64c17424a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:46.284374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1175/2358] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:45:46.292701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c8d79-bca0-4a96-ad55-b22f790d1806 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:46.294603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1f7c8d79-bca0-4a96-ad55-b22f790d1806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:46.370285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c8d79-bca0-4a96-ad55-b22f790d1806 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:46.374238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38a3c-8c27-4f04-82f7-d3adbf163353 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:46.375154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38a3c-8c27-4f04-82f7-d3adbf163353 service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.375872 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38a3c-8c27-4f04-82f7-d3adbf163353 service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.376369 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38a3c-8c27-4f04-82f7-d3adbf163353 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.392625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38a3c-8c27-4f04-82f7-d3adbf163353 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:46.395534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38a3c-8c27-4f04-82f7-d3adbf163353 service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:46.410843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1184/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:45:46.553737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f969-464f-4e80-92a6-ef4710577555 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.554364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f969-464f-4e80-92a6-ef4710577555 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.554859 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f969-464f-4e80-92a6-ef4710577555 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.556990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1176/2360] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:45:46.562152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981efd2-ac23-4147-9d03-76bc8da7956e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.562443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981efd2-ac23-4147-9d03-76bc8da7956e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.562724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981efd2-ac23-4147-9d03-76bc8da7956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.585709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9981efd2-ac23-4147-9d03-76bc8da7956e None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:46.588667 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9981efd2-ac23-4147-9d03-76bc8da7956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:46.664517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1185/2361] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:46.681105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f969-464f-4e80-92a6-ef4710577555 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:46.683919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6350f969-464f-4e80-92a6-ef4710577555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:46.701886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f969-464f-4e80-92a6-ef4710577555 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:46.706227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621f50d-2009-40e8-ac8d-745b64997f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:46.707372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621f50d-2009-40e8-ac8d-745b64997f00 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.707906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621f50d-2009-40e8-ac8d-745b64997f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.708291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621f50d-2009-40e8-ac8d-745b64997f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.720325 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621f50d-2009-40e8-ac8d-745b64997f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:46.722610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621f50d-2009-40e8-ac8d-745b64997f00 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:46.734428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1177/2362] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:46.865920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65b2b-f80f-4d38-9b23-6fcb73c4ede3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.866689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65b2b-f80f-4d38-9b23-6fcb73c4ede3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.867067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65b2b-f80f-4d38-9b23-6fcb73c4ede3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.869573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1186/2363] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:45:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:45:46.875888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a9ee-aa41-4950-80af-db404d7ef854 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.879472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a9ee-aa41-4950-80af-db404d7ef854 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.879816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a9ee-aa41-4950-80af-db404d7ef854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.902260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0b57a9ee-aa41-4950-80af-db404d7ef854 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:46.903540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0b57a9ee-aa41-4950-80af-db404d7ef854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:46.913602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1178/2364] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:46.926265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d65b2b-f80f-4d38-9b23-6fcb73c4ede3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:46.933215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:46.942597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d65b2b-f80f-4d38-9b23-6fcb73c4ede3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:46.946410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:46.947059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:46.947340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:46.947655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:46.961917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:46.963677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:46.977951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1187/2365] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:48.269970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274fd6-19f6-4235-87ce-ae58bb8874b4 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:48.270761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274fd6-19f6-4235-87ce-ae58bb8874b4 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:48.270761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274fd6-19f6-4235-87ce-ae58bb8874b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:48.299734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-59274fd6-19f6-4235-87ce-ae58bb8874b4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:48.302099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-59274fd6-19f6-4235-87ce-ae58bb8874b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:48.392129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1179/2366] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:48.408434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:48.411217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:48.435470 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c97f-52ed-4ba8-941c-4a8cb3652f27 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:48.444320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:48.447164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:48.447856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:48.448260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:48.470193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:48.472657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:48.506842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1188/2367] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:52.799367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb290-464c-459d-bd7e-bd8ed7680b02 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:52.799985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb290-464c-459d-bd7e-bd8ed7680b02 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:52.799985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb290-464c-459d-bd7e-bd8ed7680b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:52.821479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5a3cb290-464c-459d-bd7e-bd8ed7680b02 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:52.822796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5a3cb290-464c-459d-bd7e-bd8ed7680b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:52.830694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1180/2368] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:52.844594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:52.857735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e69e0-7fcf-44a8-b0a2-9da1b9c64cf5 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:52.863350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:52.864178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:52.864536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:52.864884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:52.876477 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:52.878148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:52.888453 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1189/2369] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:45:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:45:53.606896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8a8e0-7c3d-4c06-b593-b1edb86de7dc None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:53.607179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8a8e0-7c3d-4c06-b593-b1edb86de7dc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:53.607482 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8a8e0-7c3d-4c06-b593-b1edb86de7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:53.654865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-caa8a8e0-7c3d-4c06-b593-b1edb86de7dc None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:53.662186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-caa8a8e0-7c3d-4c06-b593-b1edb86de7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:53.683292 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1181/2370] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:53.700965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:53.703913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:53.740657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c838a4-551e-49e9-b503-5e8b0ccc01d0 service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:53.757816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:53.758981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:53.759635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:53.759918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:53.780598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:53.782233 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:53.806258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1190/2371] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:45:57.124466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:57.125357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:57.125357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:57.145934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:57.147290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:57.156234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1182/2372] 10.222.0.57 () {58 vars in 967 bytes} [Mon Jul 25 08:45:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:45:57.178370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:57.189790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204a2e-08c3-4925-8cc3-e258126a3348 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:57.194601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:57.195229 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:57.196129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:57.196404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:57.206590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:57.208483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:57.219789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1191/2373] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:45:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:45:59.421470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:59.423791 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:45:59.444493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438eee2-2418-44ad-8fdb-07da155400e8 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:59.449895 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:59.450850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:59.451210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:59.451526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] PATH_INFO: `/v3/users/8edc03c402b94e2cb94a65992e24d8eb` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:59.454000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edc03c402b94e2cb94a65992e24d8eb)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:59.455978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:59.490342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:59.504400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edc03c402b94e2cb94a65992e24d8eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.505058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edc03c402b94e2cb94a65992e24d8eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.505668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edc03c402b94e2cb94a65992e24d8eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.518120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edc03c402b94e2cb94a65992e24d8eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.529392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-985db6e3-74c6-4798-8a92-a115bd473f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edc03c402b94e2cb94a65992e24d8eb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.552642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1183/2374] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:45:59 2022] DELETE /identity/v3/users/8edc03c402b94e2cb94a65992e24d8eb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:59.748199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:45:59.788303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d347b-3a01-4192-87c3-4ad9aa46fa62 service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:45:59.848651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:45:59.849817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:59.850050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:59.850601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] PATH_INFO: `/v3/projects/facf3dcf449b49ee908f6d731447b1da` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:59.851912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=facf3dcf449b49ee908f6d731447b1da)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:45:59.853997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:45:59.904251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facf3dcf449b49ee908f6d731447b1da', 'request_id': 'req-1570d045-f0dd-456f-97aa-9e5d87a10c6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.911490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facf3dcf449b49ee908f6d731447b1da', 'request_id': 'req-1570d045-f0dd-456f-97aa-9e5d87a10c6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.918485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facf3dcf449b49ee908f6d731447b1da', 'request_id': 'req-1570d045-f0dd-456f-97aa-9e5d87a10c6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.950222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] The token cache is being invalidate because project facf3dcf449b49ee908f6d731447b1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:45:59.950750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.951249 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1570d045-f0dd-456f-97aa-9e5d87a10c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:45:59.953227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1192/2375] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:45:59 2022] DELETE /identity/v3/projects/facf3dcf449b49ee908f6d731447b1da => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:45:59.957864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:45:59.958160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:45:59.958438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:45:59.979974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:45:59.981210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:00.054419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1184/2376] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:00.056325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.056624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.056905 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.076833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:00.078074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:00.088501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1193/2377] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:00.095689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.106932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cff60a-0a77-485e-8835-ff0af40c488a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.111780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.112456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.112742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.113664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.114421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:46:00.114740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.116402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.130358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1185/2378] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:46:00.135538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.148140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71228-9445-497c-962b-9e5d343dac93 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.155695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.156842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.157132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.157855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.158573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.160673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.201360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:00.210495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1194/2379] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:46:00 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:46:00.217182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.246200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45604-55e8-4dcf-a8ad-d74a7fda7503 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.349638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.350931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.351296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.352205 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.352999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.355439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.384145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1186/2380] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:46:00 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:46:00.388087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.399141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd71a8-c713-41af-8529-6cd5cdf53c7c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.404422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.404803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.405092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.405586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.406585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.407805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.420995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1195/2381] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:00.424944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.435579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae60f-1efb-4a29-a442-440931697b9a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.440938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1fa97-d11c-4620-a8ad-314b2af01672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.441704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1fa97-d11c-4620-a8ad-314b2af01672 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.442206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1fa97-d11c-4620-a8ad-314b2af01672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.442576 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1fa97-d11c-4620-a8ad-314b2af01672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.443413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1fa97-d11c-4620-a8ad-314b2af01672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.445834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1fa97-d11c-4620-a8ad-314b2af01672 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.457722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1187/2382] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:00.462442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.472709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4cc6-20d9-4a26-a4ab-36662fb333b7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.477704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.478606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.478892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.479170 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] PATH_INFO: `/v3/projects/a8caee8303ab4933804866ac079aa7cd/users/ae6bb829a23f44ad8e1d076669691229/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.494703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8caee8303ab4933804866ac079aa7cd, user_id=ae6bb829a23f44ad8e1d076669691229, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.497398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.516749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1196/2383] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:46:00 2022] PUT /identity/v3/projects/a8caee8303ab4933804866ac079aa7cd/users/ae6bb829a23f44ad8e1d076669691229/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:46:00.529684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae482-729f-4ea9-88d1-cf02dc564a36 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.529684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae482-729f-4ea9-88d1-cf02dc564a36 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.529684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae482-729f-4ea9-88d1-cf02dc564a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.580607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:00.583040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1d6ae482-729f-4ea9-88d1-cf02dc564a36 None None] MFA Rules not processed for user `ae6bb829a23f44ad8e1d076669691229`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:00.585730 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1d6ae482-729f-4ea9-88d1-cf02dc564a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:00.655711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1188/2384] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:00.667722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:00.669452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:00.744019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f9657-7b6b-4218-b1e9-542ad4e91a71 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:00.748153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:00.749135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:00.749831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:00.749831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:00.760209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:00.761765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:00.771625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1197/2385] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:06.150410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479dca-16d8-45e4-81c6-3ff1382d72ed None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:06.150932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479dca-16d8-45e4-81c6-3ff1382d72ed None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:06.151035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479dca-16d8-45e4-81c6-3ff1382d72ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:06.172522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-fe479dca-16d8-45e4-81c6-3ff1382d72ed None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:06.173812 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fe479dca-16d8-45e4-81c6-3ff1382d72ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:06.267333 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1189/2386] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:06.292492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:06.295329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:06.387628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1791ab-a19b-4140-9671-2cb6b2913aae service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:06.394975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:06.395894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:06.396269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:06.396735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:06.408736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:06.411332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:06.431486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1198/2387] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:10.283821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:10.284306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:10.284306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:10.306466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:10.307727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:10.316175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1190/2388] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:10.336421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:10.348998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e1d9d-beb9-4c47-9501-19428fd91f59 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:10.356833 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e592-0f09-4215-af1e-3621468f5497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:10.357595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e592-0f09-4215-af1e-3621468f5497 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:10.357924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e592-0f09-4215-af1e-3621468f5497 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:10.358205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e592-0f09-4215-af1e-3621468f5497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:10.368026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e592-0f09-4215-af1e-3621468f5497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:10.369660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e592-0f09-4215-af1e-3621468f5497 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:10.379410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1199/2389] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:11.232140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:11.246294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31dda5-d5c3-4624-80b9-373b74ebc34a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:11.250866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:11.251773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:11.252051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:11.252320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] PATH_INFO: `/v3/users/ae6bb829a23f44ad8e1d076669691229` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:11.253506 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6bb829a23f44ad8e1d076669691229)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:11.255612 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:11.308908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6bb829a23f44ad8e1d076669691229'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.309629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6bb829a23f44ad8e1d076669691229'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.310307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6bb829a23f44ad8e1d076669691229'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.323518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6bb829a23f44ad8e1d076669691229'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.330464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6bb829a23f44ad8e1d076669691229'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.346013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1191/2390] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:46:11 2022] DELETE /identity/v3/users/ae6bb829a23f44ad8e1d076669691229 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:46:11.350600 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:11.351058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:11.351172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:11.371770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:11.372969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:11.404655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:11.433135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1200/2391] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:46:11.442588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:11.444058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:11.455138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:11.504188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662601-b675-4d45-8601-880228fdcc77 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:11.508978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0649fa-cae2-4d4b-b0bc-ed099259016d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:11.509643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0649fa-cae2-4d4b-b0bc-ed099259016d service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:11.509928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0649fa-cae2-4d4b-b0bc-ed099259016d service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:11.510206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0649fa-cae2-4d4b-b0bc-ed099259016d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:11.520639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0649fa-cae2-4d4b-b0bc-ed099259016d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:11.522152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0649fa-cae2-4d4b-b0bc-ed099259016d service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:11.534374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1192/2392] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:11.813920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:11.815503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:11.827651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a875f-b4b2-4a49-8119-815cd9b2b823 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:11.833428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:11.833428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:11.833711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:11.833925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] PATH_INFO: `/v3/projects/a8caee8303ab4933804866ac079aa7cd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:11.835346 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8caee8303ab4933804866ac079aa7cd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:11.837999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:11.887450 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8caee8303ab4933804866ac079aa7cd', 'request_id': 'req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.894710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8caee8303ab4933804866ac079aa7cd', 'request_id': 'req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.900893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8caee8303ab4933804866ac079aa7cd', 'request_id': 'req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.913161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] The token cache is being invalidate because project a8caee8303ab4933804866ac079aa7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:46:11.913449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.914657 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-69f3177d-f4a7-4e8a-bb05-7365baf3b37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:11.916256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1201/2393] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:46:11 2022] DELETE /identity/v3/projects/a8caee8303ab4933804866ac079aa7cd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:46:11.921389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:11.921688 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:11.921973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:11.941920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:11.943052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:12.018666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1193/2394] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:12.022855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.023807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.024164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.052030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:12.053036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:12.062762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1202/2395] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:12.067172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.077406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6c32-6847-4957-aed5-31bd3e0d9a28 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.082188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.082862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.083142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.083488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.084220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:46:12.084530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.086685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.098646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1194/2396] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:46:12.103537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.113020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4f773-6f6c-4d21-aa3b-b6726ad41d53 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.118516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.119190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.119505 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.119787 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.120798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.122759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.161648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1203/2397] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:46:12 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:46:12.162864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.173404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266a588-fb4b-40c6-ab5d-0a3d9eeccf6f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.231262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.231890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.232174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.232449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.233125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.235030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.255720 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1195/2398] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:46:12 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:46:12.259887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.270145 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9bea-521f-432c-b38e-b2a35bae2055 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.274740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.275378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.275687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.275964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.276690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.278277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.288214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1204/2399] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:12.292313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.302049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7dd7-1857-4b60-b6c8-434706c9adb0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.307316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005cab9-a479-4e22-ab0f-51b9245b4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.307993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005cab9-a479-4e22-ab0f-51b9245b4a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.308279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005cab9-a479-4e22-ab0f-51b9245b4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.308554 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005cab9-a479-4e22-ab0f-51b9245b4a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.309279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005cab9-a479-4e22-ab0f-51b9245b4a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.310860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005cab9-a479-4e22-ab0f-51b9245b4a48 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.321753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1196/2400] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:12.328607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.335701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f6e1-ae2d-424d-8eff-79a21c0a2841 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.340221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.341095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.341371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.341640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] PATH_INFO: `/v3/projects/26102fc21f4e44c1a34d1be98e673c63/users/fd334aedf10f4028ab81295f3d214ea9/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.357363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26102fc21f4e44c1a34d1be98e673c63, user_id=fd334aedf10f4028ab81295f3d214ea9, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.361752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.377871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1205/2401] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:46:12 2022] PUT /identity/v3/projects/26102fc21f4e44c1a34d1be98e673c63/users/fd334aedf10f4028ab81295f3d214ea9/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:46:12.383022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.383343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.383746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.403097 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:12.404440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:12.417131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:12.468542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1197/2402] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:12.478781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:12.480654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:12.540308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba8fb8-ed0a-4702-8142-83bac888f141 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:12.544028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf23b-15d6-49a6-8dd7-870629ac3c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:12.544685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf23b-15d6-49a6-8dd7-870629ac3c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:12.544972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf23b-15d6-49a6-8dd7-870629ac3c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:12.545250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf23b-15d6-49a6-8dd7-870629ac3c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:12.555376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cf23b-15d6-49a6-8dd7-870629ac3c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:12.556885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cf23b-15d6-49a6-8dd7-870629ac3c5b service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:12.562199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:12.567617 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1206/2403] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:13.078614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:13.080064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:13.155231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a290de-783d-49e6-9ec1-c25430203373 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:13.160712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:13.161366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:13.161647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:13.161951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:13.164293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:13.177353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:13.179287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:13.191450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1198/2404] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:46:14.234420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734989-f234-43c2-9128-0ed281c41adc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:14.234986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734989-f234-43c2-9128-0ed281c41adc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:14.235438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734989-f234-43c2-9128-0ed281c41adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:14.255208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-99734989-f234-43c2-9128-0ed281c41adc None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:14.256444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-99734989-f234-43c2-9128-0ed281c41adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:14.314962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1207/2405] 10.222.0.57 () {58 vars in 967 bytes} [Mon Jul 25 08:46:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:14.328604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:14.330060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:14.412221 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793ac2-f3a8-4b20-809d-669f29002b83 service placement] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:14.418591 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:14.419249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:14.419580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:14.419862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:14.430060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:14.431696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:14.443271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1199/2406] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:46:14.514193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b64d0-5a0c-4e44-88db-332767dbecfd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:14.514589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b64d0-5a0c-4e44-88db-332767dbecfd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:14.514902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b64d0-5a0c-4e44-88db-332767dbecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:14.552289 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-519b64d0-5a0c-4e44-88db-332767dbecfd None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:14.553778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-519b64d0-5a0c-4e44-88db-332767dbecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:14.563585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1208/2407] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:14.586014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:14.587872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:14.663353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:14.703511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f76904-8ceb-4dc0-b2ae-4815ecdfe3fc service swift] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:14.710406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:14.711139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:14.711549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:14.711766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:14.737815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:14.740826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:14.772995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1200/2408] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:17.026836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.027805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.028558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.063678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] MFA Rules not processed for user `fd334aedf10f4028ab81295f3d214ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:17.064850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:17.137403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1209/2409] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:17.141866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.152535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c6ee8-1652-44ff-914d-0a3236198964 service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.157446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.158197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.158550 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.158901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.159808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:17.161767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:17.195862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1201/2410] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:46:17 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:46:17.197302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.209968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012f9c-4faa-486d-9366-badc7087cb1d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.274480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.274480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.274480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.274883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.275488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:17.277436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:17.304268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1210/2411] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:46:17 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:46:17.308383 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.319173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a9380-7ec6-4cc7-ba0f-dcb536447c84 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.329579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.330279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.330569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.330850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.331728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:17.333412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:17.346063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1202/2412] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:17.350881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.363224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44864966-722e-4e4c-ac94-d42bb13eb263 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.369473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.370507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.370844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.371181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] PATH_INFO: `/v3/projects/15887f27b9534818b91683f45f6111b0/users/ded273790e7e465d8e431b353c05edba/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.388100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15887f27b9534818b91683f45f6111b0, user_id=ded273790e7e465d8e431b353c05edba, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:17.390891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:17.394740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:17.417535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1211/2413] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:46:17 2022] PUT /identity/v3/projects/15887f27b9534818b91683f45f6111b0/users/ded273790e7e465d8e431b353c05edba/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:46:17.426339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.446692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d197c-0dd8-4fbd-837a-8eb4c624f1f8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.526713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8790ce-7f57-47f3-b720-533a392040bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.527592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8790ce-7f57-47f3-b720-533a392040bd admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.527988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8790ce-7f57-47f3-b720-533a392040bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.528365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8790ce-7f57-47f3-b720-533a392040bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.529216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8790ce-7f57-47f3-b720-533a392040bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:17.531348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8790ce-7f57-47f3-b720-533a392040bd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:17.542111 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1203/2414] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:17.546397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.557589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f988f-e54a-4f23-9d40-fa3f07181785 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.568813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.570527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.570915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.571195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] PATH_INFO: `/v3/projects/15887f27b9534818b91683f45f6111b0/users/ded273790e7e465d8e431b353c05edba/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.573596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15887f27b9534818b91683f45f6111b0, user_id=ded273790e7e465d8e431b353c05edba, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:17.576482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:17.589281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1212/2415] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:46:17 2022] PUT /identity/v3/projects/15887f27b9534818b91683f45f6111b0/users/ded273790e7e465d8e431b353c05edba/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:46:17.710971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c431-6c99-4c6d-83bc-e58d1b7c6f8c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.711262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c431-6c99-4c6d-83bc-e58d1b7c6f8c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.711583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c431-6c99-4c6d-83bc-e58d1b7c6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:17.733803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5265c431-6c99-4c6d-83bc-e58d1b7c6f8c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:17.735121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5265c431-6c99-4c6d-83bc-e58d1b7c6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:17.812753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1204/2416] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:17.830762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:17.977806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668344a-f8d2-44dc-a860-e1e9e38987a0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:17.990043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:17.990889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:17.991332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:17.992393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:18.004017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:18.006187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:18.022385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1213/2417] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:46:22.615653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27a4d-de3d-4792-8cc6-13166959d214 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:22.616202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27a4d-de3d-4792-8cc6-13166959d214 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:22.616631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27a4d-de3d-4792-8cc6-13166959d214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:22.651089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-6fb27a4d-de3d-4792-8cc6-13166959d214 None None] MFA Rules not processed for user `ded273790e7e465d8e431b353c05edba`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:22.665084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-6fb27a4d-de3d-4792-8cc6-13166959d214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:22.682405 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:22.762694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1205/2418] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:22.776203 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:22.788973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13785cba-cd38-4481-9691-5955a3a4d9e5 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:22.795090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcde18-aa93-49c0-bf17-87ec9bbf9177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:22.795780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcde18-aa93-49c0-bf17-87ec9bbf9177 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:22.796311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcde18-aa93-49c0-bf17-87ec9bbf9177 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:22.796311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcde18-aa93-49c0-bf17-87ec9bbf9177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:22.865527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcde18-aa93-49c0-bf17-87ec9bbf9177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:22.867822 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcde18-aa93-49c0-bf17-87ec9bbf9177 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:22.878520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1214/2419] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:24.085135 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb202-bb12-4859-8122-7997c62df6fd None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:24.085706 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb202-bb12-4859-8122-7997c62df6fd None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:24.085813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb202-bb12-4859-8122-7997c62df6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:24.109285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a25eb202-bb12-4859-8122-7997c62df6fd None None] MFA Rules not processed for user `fd334aedf10f4028ab81295f3d214ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:24.110809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a25eb202-bb12-4859-8122-7997c62df6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:24.123283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1206/2420] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:32.874467 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=2,keystone:SELECT=69 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:33.509221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddeb6-aa39-445b-9bbf-478f2eb2ece1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:33.509510 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddeb6-aa39-445b-9bbf-478f2eb2ece1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:33.509786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddeb6-aa39-445b-9bbf-478f2eb2ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:33.533955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-52bddeb6-aa39-445b-9bbf-478f2eb2ece1 None None] MFA Rules not processed for user `a2fd9d4ef85649c6ba75876e99df4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:33.535221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-52bddeb6-aa39-445b-9bbf-478f2eb2ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:33.647212 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1215/2421] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:34.105160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=25 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:36.162160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:36.162802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:36.162802 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:36.181120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] MFA Rules not processed for user `b174788afddf426d8d276fd048f0a88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:36.182303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:36.252491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1207/2422] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:43.636242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=25 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:44.348750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba13f2-d47d-476e-b934-8b6b4f792e2c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:44.349039 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba13f2-d47d-476e-b934-8b6b4f792e2c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:44.349315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba13f2-d47d-476e-b934-8b6b4f792e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:44.369474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d7ba13f2-d47d-476e-b934-8b6b4f792e2c None None] MFA Rules not processed for user `d9d24a461bf543148b3c0e45a9d2006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:44.370865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d7ba13f2-d47d-476e-b934-8b6b4f792e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:44.425669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1216/2423] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:46.245810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=25 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:54.252566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:54.307523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4992-aada-4b1a-b7c0-000514e518c7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:54.311182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:54.311861 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:54.312180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:54.312465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:54.321854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:54.323286 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:54.333016 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1208/2424] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:54.418737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=25 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:55.165579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c95370-c9bc-43c9-aafe-da6d4dab9364 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:55.165862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c95370-c9bc-43c9-aafe-da6d4dab9364 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:55.166136 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c95370-c9bc-43c9-aafe-da6d4dab9364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:55.185829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-88c95370-c9bc-43c9-aafe-da6d4dab9364 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:55.187287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-88c95370-c9bc-43c9-aafe-da6d4dab9364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:55.195211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1217/2425] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:55.211172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:55.212876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:55.229718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb594-e79b-4951-90d9-dc2e8d5c3826 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:55.235469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:55.236147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:55.236734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:55.236734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:55.245934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:55.247588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:55.257533 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1209/2426] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:59.449490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e52bc5-1fe6-47ec-b71c-86068cba4d40 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:59.450065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e52bc5-1fe6-47ec-b71c-86068cba4d40 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:59.450065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e52bc5-1fe6-47ec-b71c-86068cba4d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:59.487734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-04e52bc5-1fe6-47ec-b71c-86068cba4d40 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:59.489137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-04e52bc5-1fe6-47ec-b71c-86068cba4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:59.499325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1218/2427] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:59.514349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:59.536350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89050632-5dcf-4304-bcd4-4e7cf6dda39d service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:59.552229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:59.553166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:59.553645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:59.554088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:59.565117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:59.567234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:59.582931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1210/2428] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:47:03.592144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3c30-7a38-4d5e-93d2-983f2fb30c49 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:03.592733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3c30-7a38-4d5e-93d2-983f2fb30c49 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:03.593029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3c30-7a38-4d5e-93d2-983f2fb30c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:03.618028 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0e3d3c30-7a38-4d5e-93d2-983f2fb30c49 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:03.619268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e3d3c30-7a38-4d5e-93d2-983f2fb30c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:03.627333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1219/2429] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:03.646750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:03.658077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bf061-c04b-4a3b-9410-1284c0de904a service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:03.663630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:03.664299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:03.664587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:03.664865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:03.673107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:03.674690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:03.684967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1211/2430] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:47:06.745355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122a4-e062-4bed-8fb1-9165de5a7f1e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:06.745874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122a4-e062-4bed-8fb1-9165de5a7f1e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:06.745998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122a4-e062-4bed-8fb1-9165de5a7f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:06.765697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b34122a4-e062-4bed-8fb1-9165de5a7f1e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:06.767026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b34122a4-e062-4bed-8fb1-9165de5a7f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:06.774934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1220/2431] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:06.790229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:06.801448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37a48-547e-4228-b28d-4414c6c214eb service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:06.807685 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d7407-b610-415c-8ea8-2f7749a0bbf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:06.808326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7407-b610-415c-8ea8-2f7749a0bbf1 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:06.808616 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7407-b610-415c-8ea8-2f7749a0bbf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:06.808896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7407-b610-415c-8ea8-2f7749a0bbf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:06.817126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d7407-b610-415c-8ea8-2f7749a0bbf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:06.818701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d7407-b610-415c-8ea8-2f7749a0bbf1 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:06.829196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1212/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:47:07.392930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:07.393218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:07.393525 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:07.412527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] MFA Rules not processed for user `bd434ec0ff3649998b7daa1bfd4dd4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:07.413746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:07.468418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1221/2433] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:09.929848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:09.930356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:09.930566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:09.951558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:09.952811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:09.961253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1213/2434] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 25 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:09.978529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:09.997403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cebea-c9af-48c2-a005-51804651d09f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:10.003497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:10.004428 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:10.004536 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:10.004757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:10.017640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:10.019498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:10.031587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1222/2435] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:47:19.946395 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=53 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:20.026077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=43 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:42.040288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.041771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:42.055109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c38f9-df1d-48ad-8536-1923d9f3e3f8 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.060377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.061362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.061715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.062052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] PATH_INFO: `/v3/users/a2fd9d4ef85649c6ba75876e99df4f45` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.063522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fd9d4ef85649c6ba75876e99df4f45)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.065473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.116854 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fd9d4ef85649c6ba75876e99df4f45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.117684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fd9d4ef85649c6ba75876e99df4f45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.118509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fd9d4ef85649c6ba75876e99df4f45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.131988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fd9d4ef85649c6ba75876e99df4f45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.140335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-073012dc-87e5-49d1-afaa-93a8a8872cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fd9d4ef85649c6ba75876e99df4f45'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.164607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1214/2436] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:47:42 2022] DELETE /identity/v3/users/a2fd9d4ef85649c6ba75876e99df4f45 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:47:42.346311 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.358147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eddcb-d7e0-4154-a0ac-f51cb3b8d6f5 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.419572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.420431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.420711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.420983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] PATH_INFO: `/v3/projects/0b249d5f8c134a9c9995d0f82544afb7` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.422152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b249d5f8c134a9c9995d0f82544afb7)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.424096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.468696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b249d5f8c134a9c9995d0f82544afb7', 'request_id': 'req-7f74eaed-d588-4193-a32e-261877428b30'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.475735 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b249d5f8c134a9c9995d0f82544afb7', 'request_id': 'req-7f74eaed-d588-4193-a32e-261877428b30'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.482043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b249d5f8c134a9c9995d0f82544afb7', 'request_id': 'req-7f74eaed-d588-4193-a32e-261877428b30'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.492907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] The token cache is being invalidate because project 0b249d5f8c134a9c9995d0f82544afb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:47:42.493198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.493848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7f74eaed-d588-4193-a32e-261877428b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:42.495485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1223/2437] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:47:42 2022] DELETE /identity/v3/projects/0b249d5f8c134a9c9995d0f82544afb7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:42.500410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.500704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.500983 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.520212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:42.521357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:42.580964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1215/2438] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:42.588701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.588993 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.589270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.609665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:42.610860 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:42.618979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1224/2439] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:42.622974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.632562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffb240-13c6-408f-b029-d9e501837c36 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.637516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.638197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.638480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.638757 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.639540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:47:42.639830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.641411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.653488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1216/2440] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:47:42.657672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.666920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d8f6-141f-4777-8c30-cc8d9dc9277a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.672156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.672803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.673090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.673370 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.674104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.676051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.703411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1225/2441] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:47:42 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:47:42.707421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.717646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ed9e6-3e94-4ea4-b32a-66afeac7f79b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.776811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.777496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.778268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.778542 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.779231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.781193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.788956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:42.803098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1217/2442] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:47:42 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:47:42.807303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.817892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7c4e-1675-4b58-a153-d67ee201d445 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.822494 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.823155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.823473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.823750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.824987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.826570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.837542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1226/2443] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:47:42.842317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.852936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f660161-52de-4ba5-a71f-b401a198d1bd admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.858159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3ac60-bb1e-409f-8899-baf13da9bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.858831 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3ac60-bb1e-409f-8899-baf13da9bdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.859119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3ac60-bb1e-409f-8899-baf13da9bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.859410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3ac60-bb1e-409f-8899-baf13da9bdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.860173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3ac60-bb1e-409f-8899-baf13da9bdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.861809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3ac60-bb1e-409f-8899-baf13da9bdcf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.873470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1218/2444] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:47:42.877692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:42.888374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4341c5b-beab-48f5-933d-2431cf353125 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:42.893045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:42.893930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.894210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.894484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] PATH_INFO: `/v3/projects/bcb55710690d4fa9b1991c3116c27cf4/users/3ab5993eff6d4817a804994a3787b3ca/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.910190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb55710690d4fa9b1991c3116c27cf4, user_id=3ab5993eff6d4817a804994a3787b3ca, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:42.913024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:42.926575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1227/2445] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:47:42 2022] PUT /identity/v3/projects/bcb55710690d4fa9b1991c3116c27cf4/users/3ab5993eff6d4817a804994a3787b3ca/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:42.931823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:42.932117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:42.932396 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:42.951653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:42.952888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:43.013976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1219/2446] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:43.023609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:43.025634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:43.059509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:43.105041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5adb34-42c5-43dd-abc4-19f4e5895356 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:43.109480 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:43.110144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:43.110474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:43.110851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:43.121254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:43.122758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:43.133138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1228/2447] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:47:43.740467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:43.742087 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:43.755201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f7d79-36fb-46ba-b98a-4caefe720838 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:43.761225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:43.762206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:43.762490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:43.762768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] PATH_INFO: `/v3/users/b174788afddf426d8d276fd048f0a88a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:43.764045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b174788afddf426d8d276fd048f0a88a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:43.765990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:43.823304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b174788afddf426d8d276fd048f0a88a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:43.823999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b174788afddf426d8d276fd048f0a88a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:43.824643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b174788afddf426d8d276fd048f0a88a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:43.841749 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b174788afddf426d8d276fd048f0a88a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:43.851346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-bacc6d8c-4bc4-4111-a836-a57aad5a3064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b174788afddf426d8d276fd048f0a88a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:43.869195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1220/2448] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:47:43 2022] DELETE /identity/v3/users/b174788afddf426d8d276fd048f0a88a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:44.360864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:44.398597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782706cc-5d36-4b8e-90b0-918243dee706 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:44.517636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:44.518517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:44.518797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:44.519121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] PATH_INFO: `/v3/projects/34a023f053a14c97b29f8945cf0c0772` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:44.520488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a023f053a14c97b29f8945cf0c0772)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:44.522624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:44.588938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a023f053a14c97b29f8945cf0c0772', 'request_id': 'req-e8985fe0-d493-4db1-a482-8bd386747983'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:44.601374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a023f053a14c97b29f8945cf0c0772', 'request_id': 'req-e8985fe0-d493-4db1-a482-8bd386747983'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:44.616929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a023f053a14c97b29f8945cf0c0772', 'request_id': 'req-e8985fe0-d493-4db1-a482-8bd386747983'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:44.634125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] The token cache is being invalidate because project 34a023f053a14c97b29f8945cf0c0772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:47:44.634995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:44.635764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8985fe0-d493-4db1-a482-8bd386747983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:47:44.638946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1229/2449] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:47:44 2022] DELETE /identity/v3/projects/34a023f053a14c97b29f8945cf0c0772 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:44.644516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:44.644772 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:44.645736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:44.673277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:44.674645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:44.776593 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:44.798981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1221/2450] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:44.809210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:44.809210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:44.809210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:44.842399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:44.843881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:44.854341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1230/2451] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:47:44.858676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:44.870715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626739af-64b4-483c-a461-7ed1b3b06efc None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:44.877470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:44.878412 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:44.878797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:44.879133 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:44.880192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:47:44.880573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:44.882303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:44.896746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1222/2452] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:47:44.901234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:44.912661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9f5c-f071-4f08-8f3d-dba356c71150 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:44.920236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:44.920989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:44.921273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:44.921548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:44.922256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:44.924378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:44.955950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1231/2453] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:47:44 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:47:44.959752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:44.970201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109c7af-4ba9-4095-86b2-c7d4488f39f0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:45.036430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:45.037162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:45.037454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:45.037733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:45.038458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:45.040480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:45.069402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1223/2454] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:47:44 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:47:45.070779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:45.087511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbdba3-011d-4f85-891d-6948071f41bb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:45.095466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:45.096838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:45.097283 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:45.097891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:45.105095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:45.112845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:45.128025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1232/2455] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:47:45.132233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:45.144817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e7def-c30f-42b4-8bc0-5482e770e0b5 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:45.151246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff31d7-c185-4a88-9b55-e4c521360ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:45.151987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff31d7-c185-4a88-9b55-e4c521360ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:45.152297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff31d7-c185-4a88-9b55-e4c521360ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:45.152585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff31d7-c185-4a88-9b55-e4c521360ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:45.153494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff31d7-c185-4a88-9b55-e4c521360ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:45.155218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff31d7-c185-4a88-9b55-e4c521360ba2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:45.172992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1224/2456] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:47:45.174322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:45.195157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158f98-7848-4573-a9be-998d07b646b2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:45.200065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:45.201071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:45.201422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:45.201777 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] PATH_INFO: `/v3/projects/c660a6f1e63d4c0f83ecb3903f26eea7/users/e923b600825341cea443b6165d8e1456/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:45.218844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c660a6f1e63d4c0f83ecb3903f26eea7, user_id=e923b600825341cea443b6165d8e1456, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:45.221922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:45.226614 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:45.245799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1233/2457] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:47:45 2022] PUT /identity/v3/projects/c660a6f1e63d4c0f83ecb3903f26eea7/users/e923b600825341cea443b6165d8e1456/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:45.251444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6c1c4-29dd-4eee-85ba-029bcc3bde40 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:45.252240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6c1c4-29dd-4eee-85ba-029bcc3bde40 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:45.252888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6c1c4-29dd-4eee-85ba-029bcc3bde40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:45.277328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-15d6c1c4-29dd-4eee-85ba-029bcc3bde40 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:45.279050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-15d6c1c4-29dd-4eee-85ba-029bcc3bde40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:45.378071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1225/2458] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:45.386091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:45.387624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:45.465862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d1f3-3b07-4807-be31-4d5c174c42c9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:45.471935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:45.472881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:45.473319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:45.473745 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:45.487653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:45.489883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:45.504220 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1234/2459] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:47:48.641725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c630-0b77-4f2a-999c-947a0d40733f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:48.642588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c630-0b77-4f2a-999c-947a0d40733f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:48.643163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c630-0b77-4f2a-999c-947a0d40733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:48.685674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0a51c630-0b77-4f2a-999c-947a0d40733f None None] MFA Rules not processed for user `3ab5993eff6d4817a804994a3787b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:48.686994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0a51c630-0b77-4f2a-999c-947a0d40733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:48.785500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:48.822393 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1226/2460] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:48.843358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:48.844967 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:48.964586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5b6b2-507f-440d-8a8b-71c9aeff522b service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:48.971372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:48.972165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:48.972591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:48.972923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:48.986036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:48.987896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:49.009543 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1235/2461] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:47:51.697473 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327307a-a889-40a4-b73b-033d915df192 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:51.698311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327307a-a889-40a4-b73b-033d915df192 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:51.698742 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327307a-a889-40a4-b73b-033d915df192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:51.754525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5327307a-a889-40a4-b73b-033d915df192 None None] MFA Rules not processed for user `e923b600825341cea443b6165d8e1456`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:51.755789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5327307a-a889-40a4-b73b-033d915df192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:51.918794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1227/2462] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:51.923442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:51.942736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf249-fc0b-448c-9a7e-447aedb52db5 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:51.969415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:51.973469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:51.973583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:51.975111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:51.978110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:51.982015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:52.055677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1236/2463] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:47:51 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:47:52.059982 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327307a-a889-40a4-b73b-033d915df192 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:52.073769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327307a-a889-40a4-b73b-033d915df192 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:52.164195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:52.165168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:52.166225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:52.167037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:52.167918 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:52.169666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:52.203411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1228/2464] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:47:52 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:47:52.207670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:52.219747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9e4b4-dee2-404b-96df-3174cc397cea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:52.225193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d144-464b-4d5c-bf2f-afc76643fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:52.226705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d144-464b-4d5c-bf2f-afc76643fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:52.227169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d144-464b-4d5c-bf2f-afc76643fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:52.227834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d144-464b-4d5c-bf2f-afc76643fe37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:52.228757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d144-464b-4d5c-bf2f-afc76643fe37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:52.230682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d144-464b-4d5c-bf2f-afc76643fe37 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:52.246961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1237/2465] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:47:52.251746 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:52.272131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8608-927d-4c6a-b878-bcdc4aef6b2b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:52.277273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:52.279197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:52.279197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:52.280465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] PATH_INFO: `/v3/projects/eae970daca3f4ac2a299aab9543c39cd/users/641758a62dd8489a8b24e1191d1801eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:52.298282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae970daca3f4ac2a299aab9543c39cd, user_id=641758a62dd8489a8b24e1191d1801eb, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:52.301561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:52.310226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:52.310556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:52.310849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:52.321046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1229/2466] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:47:52 2022] PUT /identity/v3/projects/eae970daca3f4ac2a299aab9543c39cd/users/641758a62dd8489a8b24e1191d1801eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:52.322150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:52.334094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] MFA Rules not processed for user `3ab5993eff6d4817a804994a3787b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:52.335590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:52.382880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:52.412194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:52.412998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a28b6-96a4-442c-9ddc-dcf7186135f9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:52.430400 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e7daa-1fbc-467e-b0ed-5799194a2ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:52.431498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e7daa-1fbc-467e-b0ed-5799194a2ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:52.432705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e7daa-1fbc-467e-b0ed-5799194a2ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:52.433139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e7daa-1fbc-467e-b0ed-5799194a2ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:52.434541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e7daa-1fbc-467e-b0ed-5799194a2ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:52.437373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e7daa-1fbc-467e-b0ed-5799194a2ea5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:52.440392 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1238/2467] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:52.449962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1230/2468] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:47:52.456716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:47:52.473268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e47f5-fd19-4bf0-9538-97b3cdf47b47 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:47:52.480649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e913-47bf-45a7-a55f-687ed463894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:47:52.482375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e913-47bf-45a7-a55f-687ed463894c admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:52.482375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e913-47bf-45a7-a55f-687ed463894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:52.482375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e913-47bf-45a7-a55f-687ed463894c admin admin] PATH_INFO: `/v3/projects/eae970daca3f4ac2a299aab9543c39cd/users/641758a62dd8489a8b24e1191d1801eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:52.485491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e913-47bf-45a7-a55f-687ed463894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae970daca3f4ac2a299aab9543c39cd, user_id=641758a62dd8489a8b24e1191d1801eb, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:47:52.488976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e913-47bf-45a7-a55f-687ed463894c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:47:52.516366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1239/2469] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:47:52 2022] PUT /identity/v3/projects/eae970daca3f4ac2a299aab9543c39cd/users/641758a62dd8489a8b24e1191d1801eb/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:47:56.864901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:56.865404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:56.865518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:56.922040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] MFA Rules not processed for user `d9d24a461bf543148b3c0e45a9d2006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:56.923609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:47:57.025095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1231/2470] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:47:59.908092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297d23d-f536-406d-9698-d4e146e70f94 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:47:59.908649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297d23d-f536-406d-9698-d4e146e70f94 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:47:59.908891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297d23d-f536-406d-9698-d4e146e70f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:47:59.967963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b297d23d-f536-406d-9698-d4e146e70f94 None None] MFA Rules not processed for user `641758a62dd8489a8b24e1191d1801eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:47:59.971440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b297d23d-f536-406d-9698-d4e146e70f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:00.065856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1240/2471] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:00.079099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:00.081209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:00.144602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee0331-0e61-47cd-aa6f-0be93dacee24 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:00.148118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:00.148768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:00.149070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:00.149334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:00.219898 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:00.221407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:00.231541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1232/2472] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:00.369206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:00.369496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:00.369778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:00.393156 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:00.394520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:00.453394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1241/2473] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:00.513640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:00.515156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:00.567248 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:00.599411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485d142-06d4-482c-9695-257939e5a809 service glance] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:00.605233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b41ad-da46-4052-b8de-33486836d386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:00.605956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b41ad-da46-4052-b8de-33486836d386 service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:00.606314 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b41ad-da46-4052-b8de-33486836d386 service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:00.606664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b41ad-da46-4052-b8de-33486836d386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:00.615592 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b41ad-da46-4052-b8de-33486836d386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:00.617348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b41ad-da46-4052-b8de-33486836d386 service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:00.628857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1233/2474] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:48:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:10.445263 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:10.624500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=15 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:11.437825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:11.502977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203552e-596d-42fb-9900-efd6c9279bc8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:11.506541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:11.507204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:11.507515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:11.507793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:11.509867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:11.619437 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:11.621194 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:11.643684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1242/2475] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:12.599855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bbb33-9630-4203-8bdf-3b72d90c1252 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:12.600388 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bbb33-9630-4203-8bdf-3b72d90c1252 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:12.600488 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bbb33-9630-4203-8bdf-3b72d90c1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:12.620922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b02bbb33-9630-4203-8bdf-3b72d90c1252 None None] MFA Rules not processed for user `e923b600825341cea443b6165d8e1456`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:12.622149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b02bbb33-9630-4203-8bdf-3b72d90c1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:12.629246 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1234/2476] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:48:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:13.363241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:13.365684 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:13.380087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051b70-ccf7-4b8a-b201-48d0dc6a603c service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:13.384325 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:13.385217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:13.385563 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:13.386721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:13.388910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:13.405771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:13.407628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:13.420570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1243/2477] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:14.998714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:14.999605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:14.999886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:15.021711 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:15.023163 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:15.030880 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1235/2478] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:15.045546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:15.057767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537bcba-ebce-4fb2-a717-67e14ec1eaec service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:15.063895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2a45f-7ac4-4c19-af38-c1e85bf4b937 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:15.064565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a45f-7ac4-4c19-af38-c1e85bf4b937 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:15.064850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a45f-7ac4-4c19-af38-c1e85bf4b937 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:15.065129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a45f-7ac4-4c19-af38-c1e85bf4b937 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:15.074703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2a45f-7ac4-4c19-af38-c1e85bf4b937 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:15.076284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2a45f-7ac4-4c19-af38-c1e85bf4b937 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:15.086191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1244/2479] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:48:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:19.717279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:19.717279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:19.735864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24194833-cbb4-4041-a605-e0c1358a3acf None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:19.741707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:19.742390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:19.742841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:19.743007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:19.744903 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:19.814699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:19.816654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:19.827751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1236/2480] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:25.082901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=66 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:25.086665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:25.087438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:25.088099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:25.107732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:25.108970 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:25.116280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1245/2481] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:25.129235 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:25.141380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208b6f-affa-40c1-9a4d-54760375e4ae service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:25.146969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:25.147684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:25.147971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:25.148256 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:25.157181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:25.158701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:25.166978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1237/2482] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:35.101976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:35.163841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=40 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:39.045770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:39.048469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:39.058128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:39.067917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8002-47af-40bd-b1b7-0c637fa7d32c service swift] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:39.071559 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:39.072195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:39.072477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:39.072753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:39.082359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:39.084094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:39.093973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1238/2483] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:48:39.121920 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cb676-21fe-4f39-a738-24d4b7fdac67 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:39.128866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:39.129519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:39.129808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:39.130085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:39.131977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:39.146166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:39.147925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603a5e0-cdc1-451f-81d7-ba8d02fac797 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:39.159731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1246/2484] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:40.694223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:40.703128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79209c-75d1-4df2-96e8-d8c32133e4b3 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:40.706901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:40.707590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:40.707887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:40.708169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:40.710060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:40.720862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:40.722422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:40.730642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1239/2485] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:41.146105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165c27b-8032-4862-968f-9d606d94045a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:41.146683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165c27b-8032-4862-968f-9d606d94045a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:41.147752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165c27b-8032-4862-968f-9d606d94045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:41.174620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5165c27b-8032-4862-968f-9d606d94045a None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:41.176187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5165c27b-8032-4862-968f-9d606d94045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:41.185142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1247/2486] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:41.202134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:41.216579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7b40-677f-4b38-b30e-0094bd1ce092 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:41.223902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f219aa-0e3a-4921-b939-3f9c39b609e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:41.224774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f219aa-0e3a-4921-b939-3f9c39b609e0 service swift] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:41.225220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f219aa-0e3a-4921-b939-3f9c39b609e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:41.225656 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f219aa-0e3a-4921-b939-3f9c39b609e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:41.239212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f219aa-0e3a-4921-b939-3f9c39b609e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:41.243254 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f219aa-0e3a-4921-b939-3f9c39b609e0 service swift] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:41.253295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1240/2487] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:48:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:51.166886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=35 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:51.249678 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=18 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:57.155578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165c27b-8032-4862-968f-9d606d94045a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:57.168359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165c27b-8032-4862-968f-9d606d94045a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:57.174314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:57.174964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:57.175244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:57.175547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:57.177334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:57.188178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:57.189816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:57.199517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1248/2488] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:59.304698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:59.305143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:59.305466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:59.327655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:59.329008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:59.338428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1241/2489] 10.222.0.57 () {58 vars in 967 bytes} [Mon Jul 25 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:59.353024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:59.364951 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a03b2-2382-4631-91eb-16d48c56f96a service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:59.370306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:59.370959 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:59.371243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:59.371554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:59.381887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:59.383870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:59.394119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1249/2490] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:48:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:49:05.455200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:05.473472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166014b-ffb1-4397-b2f1-78ad698fdf1a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:05.480625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:05.481386 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:05.481785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:05.482194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:05.485193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:05.512686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:05.515236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:05.548039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1242/2491] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:09.390422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=12 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:10.676723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:10.688011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdfa2e-6be3-434b-9b04-0c0e15ece1c2 service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:10.691703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:10.692349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:10.692631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:10.692915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:10.694710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:10.760854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:10.762299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:10.772211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1250/2492] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:49:14.077002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.078662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:14.092696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117fda3-becc-4a60-ba2d-8cdc360e1cf9 service nova] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.097608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.098480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.098767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.099045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] PATH_INFO: `/v3/users/d9d24a461bf543148b3c0e45a9d2006f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.100275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d24a461bf543148b3c0e45a9d2006f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.102458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.158082 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d24a461bf543148b3c0e45a9d2006f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.158744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d24a461bf543148b3c0e45a9d2006f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.159354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d24a461bf543148b3c0e45a9d2006f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.175353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d24a461bf543148b3c0e45a9d2006f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.183110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d8b6ea08-d15b-4390-99d1-bac1460a3e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d24a461bf543148b3c0e45a9d2006f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.198994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1243/2493] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:14 2022] DELETE /identity/v3/users/d9d24a461bf543148b3c0e45a9d2006f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:14.391930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.408318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb927-e7b4-4348-ad0a-a377fb07296a service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.467300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.468689 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.468979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.469255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] PATH_INFO: `/v3/projects/05f759b303a94b1d886de71d5a834746` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.470443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f759b303a94b1d886de71d5a834746)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.472444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.519596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f759b303a94b1d886de71d5a834746', 'request_id': 'req-0990b39e-0dc7-4676-90b3-1701a852c938'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.527189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f759b303a94b1d886de71d5a834746', 'request_id': 'req-0990b39e-0dc7-4676-90b3-1701a852c938'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.534003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f759b303a94b1d886de71d5a834746', 'request_id': 'req-0990b39e-0dc7-4676-90b3-1701a852c938'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.545052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] The token cache is being invalidate because project 05f759b303a94b1d886de71d5a834746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:14.545338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.546492 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0990b39e-0dc7-4676-90b3-1701a852c938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:14.549923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1251/2494] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:14 2022] DELETE /identity/v3/projects/05f759b303a94b1d886de71d5a834746 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:14.553103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.553926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.553926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.573481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:14.574702 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:14.641063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1244/2495] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:14.649780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.650064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.650342 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.670189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:14.671517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:14.680788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1252/2496] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:14.684808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.695436 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659cce7-7f81-4247-865a-116135aa22e5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.700049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.700700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.700985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.701264 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.702496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:14.702800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.704438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.716171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1245/2497] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:14.721011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.730440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a86af-e5b3-4dcc-b0ea-45749fe86aeb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.735630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.736275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.736555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.736830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.737511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.739401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.754770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:14.768728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1253/2498] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:14 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:14.772640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.782622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127b298-b1e0-4e59-8d60-53f2dfd15956 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.820230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:14.839683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.840349 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.840634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.840914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.841615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.843675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.864762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1246/2499] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:14 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:14.868805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.879573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecf7a5-92ff-47b3-ad18-f31718e964bc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.884119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.884823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.885107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.885379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.886102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.887734 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.898014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1254/2500] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:14.902044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.912457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a0eab-1692-4382-b1cc-c06662b93e54 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.917083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19670755-b06b-4795-aaff-34fd313a04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.917736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670755-b06b-4795-aaff-34fd313a04ad admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.918020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670755-b06b-4795-aaff-34fd313a04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.918295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670755-b06b-4795-aaff-34fd313a04ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.919018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19670755-b06b-4795-aaff-34fd313a04ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.921206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19670755-b06b-4795-aaff-34fd313a04ad admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.931966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1247/2501] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:49:14.936067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:14.946649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8f2e0-f10f-4b6c-af0c-4b6beb137a64 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:14.951217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:14.952116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.952398 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.952673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] PATH_INFO: `/v3/projects/07413cc0c1fe41768013097827861f4a/users/079ce142a1b14ea59067b30b6934651b/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:14.966598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07413cc0c1fe41768013097827861f4a, user_id=079ce142a1b14ea59067b30b6934651b, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:14.969779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:14.982371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1255/2502] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:14 2022] PUT /identity/v3/projects/07413cc0c1fe41768013097827861f4a/users/079ce142a1b14ea59067b30b6934651b/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:14.992986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:14.993285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:14.993570 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.021110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] MFA Rules not processed for user `079ce142a1b14ea59067b30b6934651b`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:15.022323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:15.091865 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1248/2503] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:15.096399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.158931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f33d7e-94b6-493c-b56d-42ea928f89b9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.163666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.164324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.164616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.164891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.165575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.167504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.193501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1256/2504] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:15 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:15.197699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.208959 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beacf5-78a7-4251-a233-080ac0f91139 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.266530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.267295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.267717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.267997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.268946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.271177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.294714 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1249/2505] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:15 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:15.299465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.310173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036911-8bcc-4ea2-8759-c08649891935 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.315119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.315843 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.316128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.316403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.317158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.318853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.331243 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1257/2506] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:15.335874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.347239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc67f7-bae6-4e1e-9d31-3cfe26469bd0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.352510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.353563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.353874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.354222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] PATH_INFO: `/v3/projects/39123295523d4144b4a6abfeedc8f58e/users/a6c334b02bc543df84ad2fec2e66ea6d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.372288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39123295523d4144b4a6abfeedc8f58e, user_id=a6c334b02bc543df84ad2fec2e66ea6d, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.375072 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.390509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1250/2507] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:15 2022] PUT /identity/v3/projects/39123295523d4144b4a6abfeedc8f58e/users/a6c334b02bc543df84ad2fec2e66ea6d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:15.394665 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.405826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af08b31-ebde-4ae4-bfdf-c7eda04ad89a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.464051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2944fa-e7f2-417b-8eb9-cda34e6a07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.464668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2944fa-e7f2-417b-8eb9-cda34e6a07d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.465081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2944fa-e7f2-417b-8eb9-cda34e6a07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.465374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2944fa-e7f2-417b-8eb9-cda34e6a07d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.466118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2944fa-e7f2-417b-8eb9-cda34e6a07d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.468389 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2944fa-e7f2-417b-8eb9-cda34e6a07d2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.482423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1258/2508] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:15.483693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.494095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913aa0-4c3a-4301-ac80-fffaa3de2321 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.498725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.499651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.499920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.500195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] PATH_INFO: `/v3/projects/39123295523d4144b4a6abfeedc8f58e/users/a6c334b02bc543df84ad2fec2e66ea6d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.502169 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39123295523d4144b4a6abfeedc8f58e, user_id=a6c334b02bc543df84ad2fec2e66ea6d, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.504855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.511190 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:15.516770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1251/2509] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:15 2022] PUT /identity/v3/projects/39123295523d4144b4a6abfeedc8f58e/users/a6c334b02bc543df84ad2fec2e66ea6d/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:49:15.531471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.531770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.532052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.561110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] MFA Rules not processed for user `a6c334b02bc543df84ad2fec2e66ea6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:15.562388 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:15.581209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:15.637841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1259/2510] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:15.648539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.650260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:15.709573 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82bf8-d624-4eb9-aa92-89678a477a39 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.713279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.713927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.714268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.714496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.723917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.725363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.736022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1252/2511] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:15.810521 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:15.820139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1a8d-6d40-4923-9846-d8d0be443d62 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:15.823791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9d7d-aee3-4744-b012-e3d9c42510d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:15.824439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9d7d-aee3-4744-b012-e3d9c42510d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:15.824743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9d7d-aee3-4744-b012-e3d9c42510d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:15.825008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9d7d-aee3-4744-b012-e3d9c42510d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:15.881260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb9d7d-aee3-4744-b012-e3d9c42510d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:15.882737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb9d7d-aee3-4744-b012-e3d9c42510d1 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:15.891699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1260/2512] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:19.977364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:20.038513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c736060-f398-4db5-a91c-36b7b09382de service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:20.043107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:20.044014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.044303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.044581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] PATH_INFO: `/v3/users/079ce142a1b14ea59067b30b6934651b` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.046305 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=079ce142a1b14ea59067b30b6934651b)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:20.048324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:20.097452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079ce142a1b14ea59067b30b6934651b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.098272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079ce142a1b14ea59067b30b6934651b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.098929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079ce142a1b14ea59067b30b6934651b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.111747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079ce142a1b14ea59067b30b6934651b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.118511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079ce142a1b14ea59067b30b6934651b'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.131147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1253/2513] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:19 2022] DELETE /identity/v3/users/079ce142a1b14ea59067b30b6934651b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:20.135733 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b68b8-c9aa-4ba7-9e96-7f968f343b95 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.136207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b68b8-c9aa-4ba7-9e96-7f968f343b95 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.136321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b68b8-c9aa-4ba7-9e96-7f968f343b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.154866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-389b68b8-c9aa-4ba7-9e96-7f968f343b95 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:20.156148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-389b68b8-c9aa-4ba7-9e96-7f968f343b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:20.219264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1261/2514] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:20.229228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:20.230846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:20.265243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:20.312804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c173515-5386-46af-9cac-430f3e35a88a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:20.319062 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbee8f-387e-48e5-b046-6b2e968de812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:20.319750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbee8f-387e-48e5-b046-6b2e968de812 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.320101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbee8f-387e-48e5-b046-6b2e968de812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.320306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbee8f-387e-48e5-b046-6b2e968de812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.330530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbee8f-387e-48e5-b046-6b2e968de812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:20.331993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbee8f-387e-48e5-b046-6b2e968de812 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:20.343584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1254/2515] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:20.488874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ce59-9fee-40c1-883d-6c2c8461eb7c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.489191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ce59-9fee-40c1-883d-6c2c8461eb7c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.489727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ce59-9fee-40c1-883d-6c2c8461eb7c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.491814 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1262/2516] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:49:20.498298 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36595c-23d8-4a0b-b940-5e8b5bba1e16 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.500359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36595c-23d8-4a0b-b940-5e8b5bba1e16 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.500715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36595c-23d8-4a0b-b940-5e8b5bba1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.522115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cf36595c-23d8-4a0b-b940-5e8b5bba1e16 None None] MFA Rules not processed for user `1d85eeb2282b4f9ca9f357c0e0948de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:20.523332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cf36595c-23d8-4a0b-b940-5e8b5bba1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:20.539768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1255/2517] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:20.554250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ce59-9fee-40c1-883d-6c2c8461eb7c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:20.565911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ce59-9fee-40c1-883d-6c2c8461eb7c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:20.569861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853833-5df9-4c02-ac06-bc9a0736489e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:20.570808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853833-5df9-4c02-ac06-bc9a0736489e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.571187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853833-5df9-4c02-ac06-bc9a0736489e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.571686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853833-5df9-4c02-ac06-bc9a0736489e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.579974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853833-5df9-4c02-ac06-bc9a0736489e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:20.581861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853833-5df9-4c02-ac06-bc9a0736489e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:20.591230 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1263/2518] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:20.694323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a999-8855-4c0a-a167-508a6ea35942 None None] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.694857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a999-8855-4c0a-a167-508a6ea35942 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.695296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a999-8855-4c0a-a167-508a6ea35942 None None] PATH_INFO: `/` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.697017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1256/2519] 10.222.0.57 () {54 vars in 921 bytes} [Mon Jul 25 08:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:49:20.706940 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.707234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.707558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.729399 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] MFA Rules not processed for user `17968a13a13d4ad49956f1276256e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:20.730595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:20.771822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a999-8855-4c0a-a167-508a6ea35942 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:20.773938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-31c4a999-8855-4c0a-a167-508a6ea35942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:20.781252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:20.802346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a999-8855-4c0a-a167-508a6ea35942 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:20.809912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:20.810780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.811061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.811928 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] PATH_INFO: `/v3/projects/07413cc0c1fe41768013097827861f4a` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.813140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07413cc0c1fe41768013097827861f4a)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:20.815126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:20.818008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1264/2520] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Jul 25 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:20.829675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:20.831161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:20.842429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bb7d6-c153-4542-9d35-e3add59b73e2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:20.846176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:20.846863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.847142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.847449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.858882 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:20.860625 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:20.866078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07413cc0c1fe41768013097827861f4a', 'request_id': 'req-4c1bd63c-e602-4456-a286-9d01344b0018'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.872226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1265/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:49:20.874551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07413cc0c1fe41768013097827861f4a', 'request_id': 'req-4c1bd63c-e602-4456-a286-9d01344b0018'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.881060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07413cc0c1fe41768013097827861f4a', 'request_id': 'req-4c1bd63c-e602-4456-a286-9d01344b0018'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.892509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] The token cache is being invalidate because project 07413cc0c1fe41768013097827861f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:20.892796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.893453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:20.895003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1257/2522] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:20 2022] DELETE /identity/v3/projects/07413cc0c1fe41768013097827861f4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:20.899275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:20.910400 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20e98-4aed-4faf-aa80-3b147287fb1d service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:20.970999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:20.971908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:20.972190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:20.972473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] PATH_INFO: `/v3/users/a6c334b02bc543df84ad2fec2e66ea6d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:20.973709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c334b02bc543df84ad2fec2e66ea6d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:20.975673 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.023626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c334b02bc543df84ad2fec2e66ea6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.024306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c334b02bc543df84ad2fec2e66ea6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.024937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c334b02bc543df84ad2fec2e66ea6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.039938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c334b02bc543df84ad2fec2e66ea6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.047968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a4f4f807-e931-4dd5-9cc1-c03ac4b3be39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c334b02bc543df84ad2fec2e66ea6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.063051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1266/2523] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:20 2022] DELETE /identity/v3/users/a6c334b02bc543df84ad2fec2e66ea6d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:21.359144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.360821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:21.374846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd63c-e602-4456-a286-9d01344b0018 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.442467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.443338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.443656 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.443936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] PATH_INFO: `/v3/projects/39123295523d4144b4a6abfeedc8f58e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.445121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39123295523d4144b4a6abfeedc8f58e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:21.447916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.491445 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:21.495814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39123295523d4144b4a6abfeedc8f58e', 'request_id': 'req-6c471dce-cd26-4af1-9fd8-bf673ad16546'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.505237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39123295523d4144b4a6abfeedc8f58e', 'request_id': 'req-6c471dce-cd26-4af1-9fd8-bf673ad16546'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.511182 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39123295523d4144b4a6abfeedc8f58e', 'request_id': 'req-6c471dce-cd26-4af1-9fd8-bf673ad16546'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.523779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] The token cache is being invalidate because project 39123295523d4144b4a6abfeedc8f58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:21.524073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.524795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6c471dce-cd26-4af1-9fd8-bf673ad16546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:21.526597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1258/2524] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:21 2022] DELETE /identity/v3/projects/39123295523d4144b4a6abfeedc8f58e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:21.531912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.532408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.532638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.553514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:21.554739 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:21.598569 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:21.631610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1267/2525] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:21.638736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.639023 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.639917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.663448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:21.664761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:21.675824 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1259/2526] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:21.680105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.692616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b320dcc-ed5b-452d-8e58-1795f664e86e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.697487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.698179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.698654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.698978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.700380 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:21.700701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:21.702837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.725746 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1268/2527] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:21.727976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.742069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec16d8-9e2c-4ba5-840f-5d4fd3f570a1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.748519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.749583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.749867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.750142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.750845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:21.754115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.803435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1260/2528] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:21 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:21.806973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.818438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cb5fa-130f-46f0-8a56-4c8aa2ec47ff admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.888811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.888811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.888811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.888811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.889208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:21.889208 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.913116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1269/2529] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:21 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:21.917280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.928085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27729e1b-4f30-49e3-b3f1-e0b16c160867 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.932770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.933438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.933727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.934006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.934771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:21.936485 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.946620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1261/2530] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:21.950164 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.960130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ad07d-0acb-4db0-b96b-0458f1488e14 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.964646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f9485-8939-40ac-a8dd-c2431674f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.965291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f9485-8939-40ac-a8dd-c2431674f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.965574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f9485-8939-40ac-a8dd-c2431674f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:21.965856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f9485-8939-40ac-a8dd-c2431674f9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:21.966583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f9485-8939-40ac-a8dd-c2431674f9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:21.968763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f9485-8939-40ac-a8dd-c2431674f9ef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:21.979295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1270/2531] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:49:21.983870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:21.993809 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99702e4-a30d-4481-8267-5a387391f741 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:21.998621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:21.999531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:21.999821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.000101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] PATH_INFO: `/v3/projects/53504442dcba4d5d93e331edd3cb73d8/users/95053465bf7c4760bbb96e56f65eaeb7/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.015350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53504442dcba4d5d93e331edd3cb73d8, user_id=95053465bf7c4760bbb96e56f65eaeb7, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.018309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.031375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1262/2532] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:21 2022] PUT /identity/v3/projects/53504442dcba4d5d93e331edd3cb73d8/users/95053465bf7c4760bbb96e56f65eaeb7/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:22.043946 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.044235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.044513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.073901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] MFA Rules not processed for user `95053465bf7c4760bbb96e56f65eaeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:22.075106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:22.147790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1271/2533] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:22.149780 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.218561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900786-80e1-475c-8b15-267d61c72817 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.223288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.223997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.224277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.224575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.225266 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.227449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.258098 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1263/2534] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:22 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:22.259416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.270456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb844-32a4-4739-8589-4fca59a38600 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.302832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:22.330594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.331281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.331598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.331879 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.332647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.334623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.357764 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1272/2535] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:22 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:22.362315 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.372725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f937-78ea-40bd-9b1b-845984512c16 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.378120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.378788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.379075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.379353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.380120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.381942 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.395957 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1264/2536] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:22.397166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.408322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d50ffb-f32d-4a49-b460-ec3b4794bfa9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.412962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be52de-8e59-44d6-b57a-b3ba743f6853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.413638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be52de-8e59-44d6-b57a-b3ba743f6853 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.413926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be52de-8e59-44d6-b57a-b3ba743f6853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.414204 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be52de-8e59-44d6-b57a-b3ba743f6853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.414939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be52de-8e59-44d6-b57a-b3ba743f6853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.416594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be52de-8e59-44d6-b57a-b3ba743f6853 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.429352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1273/2537] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:49:22.431750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.442089 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641947-e256-494c-8537-e2b81acb7f9b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.446731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.447645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.447932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.448209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] PATH_INFO: `/v3/projects/18b9d4e00fba4f7aa3378db1e128f56f/users/62401ec6be8a4c75be25722ef9b4baef/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.463637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b9d4e00fba4f7aa3378db1e128f56f, user_id=62401ec6be8a4c75be25722ef9b4baef, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.466321 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.479437 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1265/2538] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:22 2022] PUT /identity/v3/projects/18b9d4e00fba4f7aa3378db1e128f56f/users/62401ec6be8a4c75be25722ef9b4baef/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:22.490984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.491810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.492216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.524034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] MFA Rules not processed for user `62401ec6be8a4c75be25722ef9b4baef`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:22.525295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:22.596775 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1274/2539] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:49:22.601313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.621211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:22.668423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75f28-ad27-470e-968c-ee47beb05b4a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.673106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.673787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.674055 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.674334 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.675028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.676999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.717091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1266/2540] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:22 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:22.721667 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.732873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7ae0-2e99-455c-af69-def863aacc04 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.793883 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.794581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.794862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.795134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.796507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.798441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.824797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1275/2541] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:22 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:22.825948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.837069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915a8d-35c6-4709-8089-613a1932ccbf admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.841972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.843239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.843562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.843843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.844579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.846177 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.857528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1267/2542] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:22.863862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.874816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eba93-f38d-422b-bc35-c773491652e1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.879670 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.880680 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.880972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:22.881256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] PATH_INFO: `/v3/projects/2d8d8f4a68ae4e3a96eb37ab584a0a31/users/6d6cdaee21614c64b5602a94260fa28f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:22.896597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8d8f4a68ae4e3a96eb37ab584a0a31, user_id=6d6cdaee21614c64b5602a94260fa28f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:22.899367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:22.914406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1276/2543] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:22 2022] PUT /identity/v3/projects/2d8d8f4a68ae4e3a96eb37ab584a0a31/users/6d6cdaee21614c64b5602a94260fa28f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:22.918223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:22.929300 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2543-d73a-48c9-995f-a1272563b42c admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:22.998733 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37ce99-33bd-48b6-b555-3e39dceddb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:22.999635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37ce99-33bd-48b6-b555-3e39dceddb82 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:22.999975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37ce99-33bd-48b6-b555-3e39dceddb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:23.000259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37ce99-33bd-48b6-b555-3e39dceddb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:23.000995 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37ce99-33bd-48b6-b555-3e39dceddb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:23.002589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37ce99-33bd-48b6-b555-3e39dceddb82 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:23.014659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1268/2544] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:23.017483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:23.027853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde8882-a4d9-43eb-b735-0c8cc0063614 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:23.032591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:23.033550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:23.033839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:23.034115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] PATH_INFO: `/v3/projects/2d8d8f4a68ae4e3a96eb37ab584a0a31/users/6d6cdaee21614c64b5602a94260fa28f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:23.036139 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8d8f4a68ae4e3a96eb37ab584a0a31, user_id=6d6cdaee21614c64b5602a94260fa28f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:23.038772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:23.042144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:23.051451 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1277/2545] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:23 2022] PUT /identity/v3/projects/2d8d8f4a68ae4e3a96eb37ab584a0a31/users/6d6cdaee21614c64b5602a94260fa28f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:23.061121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf144-b549-466f-ad67-790104201930 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:23.062017 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf144-b549-466f-ad67-790104201930 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:23.062297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf144-b549-466f-ad67-790104201930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:23.090194 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-e6dbf144-b549-466f-ad67-790104201930 None None] MFA Rules not processed for user `6d6cdaee21614c64b5602a94260fa28f`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:23.091469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e6dbf144-b549-466f-ad67-790104201930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:23.158018 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1269/2546] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:23.169272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:23.171541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:23.228772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d46b6-fa7a-4b0a-ad31-945601ba2d04 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:23.232612 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:23.233839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:23.234125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:23.234404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:23.243587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:23.245029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:23.254397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1278/2547] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:23.296323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf144-b549-466f-ad67-790104201930 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:23.297755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-e6dbf144-b549-466f-ad67-790104201930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:23.310508 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf144-b549-466f-ad67-790104201930 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:23.314920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:23.315607 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:23.315910 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:23.316166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:23.325797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:23.376156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:23.378091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:23.387420 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1270/2548] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:23.414046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:23.415513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:23.511851 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0da58-303c-4980-91a8-20e3c96dcaa4 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:23.520335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:23.521000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:23.521282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:23.521558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:23.523366 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:23.540255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:23.541852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adb5d7-1d7b-4383-99c6-383176d27cc7 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:23.552642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1279/2549] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:26.272632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:26.334672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcda5d6-f698-481c-943d-2f1bcee67ed8 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:26.339187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:26.340101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:26.340390 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:26.340669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] PATH_INFO: `/v3/users/95053465bf7c4760bbb96e56f65eaeb7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:26.341848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95053465bf7c4760bbb96e56f65eaeb7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:26.343836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:26.391769 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95053465bf7c4760bbb96e56f65eaeb7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:26.392564 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95053465bf7c4760bbb96e56f65eaeb7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:26.393279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95053465bf7c4760bbb96e56f65eaeb7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:26.406155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95053465bf7c4760bbb96e56f65eaeb7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:26.413173 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95053465bf7c4760bbb96e56f65eaeb7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:26.426763 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1271/2550] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:26 2022] DELETE /identity/v3/users/95053465bf7c4760bbb96e56f65eaeb7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:26.431326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:26.431895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:26.431895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:26.451332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:26.453059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:26.518827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1280/2551] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:26.534999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:26.536641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:26.585476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:26.612913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d6240-b1ea-4e06-9352-717054b4482e admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:26.616680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:26.617348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:26.617631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:26.617908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:26.628816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:26.630277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:26.641268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1272/2552] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:26.929165 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:26.930936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:26.944998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b762-12ff-43af-bfb6-294d6fb64f38 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:26.949628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:26.950506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:26.950789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:26.951058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] PATH_INFO: `/v3/projects/53504442dcba4d5d93e331edd3cb73d8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:26.952811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53504442dcba4d5d93e331edd3cb73d8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:26.954713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:26.977533 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:27.003760 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53504442dcba4d5d93e331edd3cb73d8', 'request_id': 'req-3eda774c-e07e-4bd7-9017-72e2fb4f672d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.011078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53504442dcba4d5d93e331edd3cb73d8', 'request_id': 'req-3eda774c-e07e-4bd7-9017-72e2fb4f672d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.017302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53504442dcba4d5d93e331edd3cb73d8', 'request_id': 'req-3eda774c-e07e-4bd7-9017-72e2fb4f672d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.028287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] The token cache is being invalidate because project 53504442dcba4d5d93e331edd3cb73d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:27.028597 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.029221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.030854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1281/2553] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:26 2022] DELETE /identity/v3/projects/53504442dcba4d5d93e331edd3cb73d8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:27.034858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:27.044514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e883246-01bd-405c-9cb3-bd8043955639 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:27.103549 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:27.104468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:27.104755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:27.105034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] PATH_INFO: `/v3/users/62401ec6be8a4c75be25722ef9b4baef` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:27.106379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62401ec6be8a4c75be25722ef9b4baef)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:27.108493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:27.162882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62401ec6be8a4c75be25722ef9b4baef'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.163608 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62401ec6be8a4c75be25722ef9b4baef'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.164280 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62401ec6be8a4c75be25722ef9b4baef'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.177610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62401ec6be8a4c75be25722ef9b4baef'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.184747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62401ec6be8a4c75be25722ef9b4baef'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.200401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1273/2554] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:27 2022] DELETE /identity/v3/users/62401ec6be8a4c75be25722ef9b4baef => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:27.468648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:27.470215 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:27.492176 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda774c-e07e-4bd7-9017-72e2fb4f672d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:27.574135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:27.575555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:27.575964 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:27.578619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] PATH_INFO: `/v3/projects/18b9d4e00fba4f7aa3378db1e128f56f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:27.579485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b9d4e00fba4f7aa3378db1e128f56f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:27.581692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:27.632275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b9d4e00fba4f7aa3378db1e128f56f', 'request_id': 'req-632ea237-aa69-47e5-bc9c-c60aa63b8e94'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.641198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b9d4e00fba4f7aa3378db1e128f56f', 'request_id': 'req-632ea237-aa69-47e5-bc9c-c60aa63b8e94'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.647121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b9d4e00fba4f7aa3378db1e128f56f', 'request_id': 'req-632ea237-aa69-47e5-bc9c-c60aa63b8e94'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.659355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] The token cache is being invalidate because project 18b9d4e00fba4f7aa3378db1e128f56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:27.659675 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.660324 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.662090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1282/2555] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:27 2022] DELETE /identity/v3/projects/18b9d4e00fba4f7aa3378db1e128f56f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:27.665892 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:27.667561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:27.680566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb35b-6f7a-4c11-991a-f537f27363bc admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:27.731781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:27.742924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:27.743844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:27.744129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:27.744413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] PATH_INFO: `/v3/users/6d6cdaee21614c64b5602a94260fa28f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:27.748188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6cdaee21614c64b5602a94260fa28f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:27.750722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:27.796703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6cdaee21614c64b5602a94260fa28f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.797294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6cdaee21614c64b5602a94260fa28f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.797896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6cdaee21614c64b5602a94260fa28f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.809500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6cdaee21614c64b5602a94260fa28f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.816803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-599b656f-5799-4010-8050-37ea5f8a4c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6cdaee21614c64b5602a94260fa28f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:27.829481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1274/2556] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:27 2022] DELETE /identity/v3/users/6d6cdaee21614c64b5602a94260fa28f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:28.091854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.094019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:28.109580 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ea237-aa69-47e5-bc9c-c60aa63b8e94 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.145742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:28.173737 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.174635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.174917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.175193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] PATH_INFO: `/v3/projects/2d8d8f4a68ae4e3a96eb37ab584a0a31` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.176415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8d8f4a68ae4e3a96eb37ab584a0a31)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.178336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.225817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8d8f4a68ae4e3a96eb37ab584a0a31', 'request_id': 'req-88fafcd6-939e-418d-81d6-3a61c3f20f01'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:28.234101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8d8f4a68ae4e3a96eb37ab584a0a31', 'request_id': 'req-88fafcd6-939e-418d-81d6-3a61c3f20f01'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:28.239626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8d8f4a68ae4e3a96eb37ab584a0a31', 'request_id': 'req-88fafcd6-939e-418d-81d6-3a61c3f20f01'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:28.250896 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] The token cache is being invalidate because project 2d8d8f4a68ae4e3a96eb37ab584a0a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:28.251183 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:28.251831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-88fafcd6-939e-418d-81d6-3a61c3f20f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:28.253351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1283/2557] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:28 2022] DELETE /identity/v3/projects/2d8d8f4a68ae4e3a96eb37ab584a0a31 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:28.261121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.261413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.261692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.281820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:28.283020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:28.340443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1275/2558] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:28.348804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.349087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.349389 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.369476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:28.370674 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:28.379368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1284/2559] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:28.384064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.394179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074227b-60d9-48ee-b4c7-618f276ee8e0 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.398781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.399459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.399747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.400026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.400753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:28.401060 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.402655 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.414064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1276/2560] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:28.418267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.428925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec489c-b2ca-446c-8359-b9abf0dea1d0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.433846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.434508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.434786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.435058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.435839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.438362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.464393 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1285/2561] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:28.469001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.479196 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ecdff-30e1-4a06-ae34-8be4fcdfb66b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.534507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.535172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.535487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.535762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.536461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.538368 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.546748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:28.562095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1277/2562] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:28.565668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.576027 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08754bb5-9805-4647-9d28-2ca8162accba admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.580604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.581260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.581550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.581827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.582558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.584201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.595101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1286/2563] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:28.599003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.609796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc283cc-4cc6-4390-8d5c-f9908b7c93d1 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.614411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865731-9d78-44bf-a898-662b757d7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.615117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865731-9d78-44bf-a898-662b757d7f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.615374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865731-9d78-44bf-a898-662b757d7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.615659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865731-9d78-44bf-a898-662b757d7f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.616376 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d865731-9d78-44bf-a898-662b757d7f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.617973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d865731-9d78-44bf-a898-662b757d7f4b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.628997 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1278/2564] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:28.633234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.643944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f33f-1889-498e-b8e8-1b5500d09136 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.648555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.649429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.649710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.649982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] PATH_INFO: `/v3/projects/bc1d01c880ba41c5a2b690726b9746de/users/b12eab165358481aac4f75441d1f3bfe/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.663985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1d01c880ba41c5a2b690726b9746de, user_id=b12eab165358481aac4f75441d1f3bfe, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.666628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.679248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1287/2565] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:28 2022] PUT /identity/v3/projects/bc1d01c880ba41c5a2b690726b9746de/users/b12eab165358481aac4f75441d1f3bfe/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:28.691818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.692307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.692426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.719836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] MFA Rules not processed for user `b12eab165358481aac4f75441d1f3bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:28.721039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:28.787937 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1279/2566] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:28.792411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.856862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f27a2c-cf41-4b43-a9c7-c0c8449bc145 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.862616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.863267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.863587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.863870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.864576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.866491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.876861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:28.896561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1288/2567] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:28.900145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:28.910896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f373b-7dae-46e1-a94d-778d0635f878 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:28.969397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:28.970070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:28.970355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:28.970634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:28.971357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:28.973361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:28.996975 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1280/2568] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:28 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:28.998111 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:29.008607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de450a-5424-45dc-a95a-99209c5454e3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:29.013345 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:29.014004 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.014850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.015126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.015900 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:29.017500 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:29.027403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1289/2569] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:29.031934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:29.041852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee839e-8336-45b6-899e-117dc220f50a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:29.047202 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:29.048122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.048434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.048715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] PATH_INFO: `/v3/projects/171825337d364bd3b1e4ce012635458e/users/c4889abfb676468a9e03821ce72c7e1c/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.064813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=171825337d364bd3b1e4ce012635458e, user_id=c4889abfb676468a9e03821ce72c7e1c, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:29.067480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:29.079998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1281/2570] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:29 2022] PUT /identity/v3/projects/171825337d364bd3b1e4ce012635458e/users/c4889abfb676468a9e03821ce72c7e1c/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:29.084012 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:29.094825 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9722b-44d6-4deb-b4ed-b9f70fc72f1b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:29.156161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2f706-0f0a-4420-b3eb-e5421037ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:29.156763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2f706-0f0a-4420-b3eb-e5421037ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.157250 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2f706-0f0a-4420-b3eb-e5421037ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.157586 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2f706-0f0a-4420-b3eb-e5421037ef71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.158333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2f706-0f0a-4420-b3eb-e5421037ef71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:29.159977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2f706-0f0a-4420-b3eb-e5421037ef71 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:29.174210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1290/2571] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:29.175373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:29.188715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229166f-40b2-4a91-a94e-d74fe46cdf5f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:29.193466 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:29.194413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.194698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.194974 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] PATH_INFO: `/v3/projects/171825337d364bd3b1e4ce012635458e/users/c4889abfb676468a9e03821ce72c7e1c/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.197071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171825337d364bd3b1e4ce012635458e, user_id=c4889abfb676468a9e03821ce72c7e1c, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:29.199825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:29.210701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1282/2572] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:29 2022] PUT /identity/v3/projects/171825337d364bd3b1e4ce012635458e/users/c4889abfb676468a9e03821ce72c7e1c/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:29.221496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.221808 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.222093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.252273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] MFA Rules not processed for user `c4889abfb676468a9e03821ce72c7e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:29.253513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:29.322246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1291/2573] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:29.333509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:29.335214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:29.362317 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:29.400044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd147c-e619-485c-ae8d-3aa99a6bace8 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:29.403705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1abeda-e388-4016-aacf-8f728fc13dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:29.404347 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abeda-e388-4016-aacf-8f728fc13dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.404628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abeda-e388-4016-aacf-8f728fc13dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.405449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abeda-e388-4016-aacf-8f728fc13dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.415014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1abeda-e388-4016-aacf-8f728fc13dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:29.416423 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1abeda-e388-4016-aacf-8f728fc13dc9 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:29.426513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1283/2574] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:29.804803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:29.867195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835f4dd-5a30-4b69-91d1-c8ffde0319d1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:29.871874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:29.872758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.873043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.873320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] PATH_INFO: `/v3/users/b12eab165358481aac4f75441d1f3bfe` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.875095 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12eab165358481aac4f75441d1f3bfe)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:29.877069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:29.878604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:29.923591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12eab165358481aac4f75441d1f3bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:29.924172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12eab165358481aac4f75441d1f3bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:29.924781 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12eab165358481aac4f75441d1f3bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:29.937178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12eab165358481aac4f75441d1f3bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:29.944231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12eab165358481aac4f75441d1f3bfe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:29.956513 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1292/2575] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:29 2022] DELETE /identity/v3/users/b12eab165358481aac4f75441d1f3bfe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:29.961045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:29.961504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:29.961614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:29.980625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:29.981833 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:30.044755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1284/2576] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:30.055626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:30.057113 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:30.116114 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61275a-a05c-44e9-bcd0-3de9c411dffe admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:30.119965 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:30.120620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:30.120968 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:30.121251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:30.131463 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:30.132926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:30.143635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1293/2577] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:30.404413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:30.406462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:30.419581 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b0aa-bcd2-49d8-85ce-388a99f42e7f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:30.424379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:30.425251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:30.425539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:30.425814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] PATH_INFO: `/v3/projects/bc1d01c880ba41c5a2b690726b9746de` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:30.427004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1d01c880ba41c5a2b690726b9746de)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:30.428964 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:30.475924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1d01c880ba41c5a2b690726b9746de', 'request_id': 'req-5b8b3d7c-f880-4348-8f53-02d73d9193fc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.482986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1d01c880ba41c5a2b690726b9746de', 'request_id': 'req-5b8b3d7c-f880-4348-8f53-02d73d9193fc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.488415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1d01c880ba41c5a2b690726b9746de', 'request_id': 'req-5b8b3d7c-f880-4348-8f53-02d73d9193fc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.499139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] The token cache is being invalidate because project bc1d01c880ba41c5a2b690726b9746de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:30.499450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.500083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.501602 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1285/2578] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:30 2022] DELETE /identity/v3/projects/bc1d01c880ba41c5a2b690726b9746de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:30.505548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:30.515708 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adac1fa-2a21-4577-ba82-cb174484292a service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:30.571976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:30.572838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:30.573121 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:30.573426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] PATH_INFO: `/v3/users/c4889abfb676468a9e03821ce72c7e1c` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:30.574608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4889abfb676468a9e03821ce72c7e1c)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:30.577106 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:30.599098 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:30.625409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4889abfb676468a9e03821ce72c7e1c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.626076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4889abfb676468a9e03821ce72c7e1c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.626691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4889abfb676468a9e03821ce72c7e1c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.638660 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4889abfb676468a9e03821ce72c7e1c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.645984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68fbf08b-685b-4ed4-b380-f5d425462843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4889abfb676468a9e03821ce72c7e1c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:30.658137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1294/2579] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:30 2022] DELETE /identity/v3/users/c4889abfb676468a9e03821ce72c7e1c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:30.933394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:30.934935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:30.948161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3d7c-f880-4348-8f53-02d73d9193fc admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:30.993035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:31.007326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.008217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.008497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.008773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] PATH_INFO: `/v3/projects/171825337d364bd3b1e4ce012635458e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.009938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171825337d364bd3b1e4ce012635458e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.011889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.057588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171825337d364bd3b1e4ce012635458e', 'request_id': 'req-20bfa70e-2926-4f67-8758-b42724ffdef5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:31.064507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171825337d364bd3b1e4ce012635458e', 'request_id': 'req-20bfa70e-2926-4f67-8758-b42724ffdef5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:31.070073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171825337d364bd3b1e4ce012635458e', 'request_id': 'req-20bfa70e-2926-4f67-8758-b42724ffdef5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:31.081409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] The token cache is being invalidate because project 171825337d364bd3b1e4ce012635458e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:31.081695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:31.082326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-20bfa70e-2926-4f67-8758-b42724ffdef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:31.083875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1286/2580] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:30 2022] DELETE /identity/v3/projects/171825337d364bd3b1e4ce012635458e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:31.089130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.089622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.089720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.110045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:31.111261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:31.172478 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1295/2581] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:31.181105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.181399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.181677 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.201093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:31.202803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:31.210784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1287/2582] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:31.214839 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.225184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3f257-b365-4958-a6d2-b8fdb48f1fec None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.230412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.231036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.231318 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.231633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.232362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:31.232671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.234273 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.245880 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1296/2583] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:31.250106 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.259220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dabaa8-b022-47e6-b892-9fb4c098e760 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.263843 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.265006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.265290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.265571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.266252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.268171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.295095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1288/2584] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:31.299248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.309186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005695f-fc90-4280-9859-78e09d9de97a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.366834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.367535 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.367823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.368102 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.368785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.370713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.399123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1297/2585] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:31.403216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.414029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36241c-b4cd-4d4f-baf4-8227bf619d2a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.418869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.419566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.419845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.420119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.420834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.422417 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.432523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1289/2586] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:31.438160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.448475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cae2bf-0f0f-4bd7-9c53-68f72ecd6fbc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.453482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805205c1-7627-4a92-9956-04c4a681c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.454271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805205c1-7627-4a92-9956-04c4a681c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.454557 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805205c1-7627-4a92-9956-04c4a681c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.454836 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805205c1-7627-4a92-9956-04c4a681c6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.455661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805205c1-7627-4a92-9956-04c4a681c6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.457293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805205c1-7627-4a92-9956-04c4a681c6cd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.469447 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1298/2587] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:31.473579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.485663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d93f8-1833-4dc1-adc8-b92e37587f81 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.490227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.491103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.491410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.491694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] PATH_INFO: `/v3/projects/0a6ace3f4c114b688cee53b1731f0e92/users/3b4702aae20d49a093884e359ae5650a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.505813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6ace3f4c114b688cee53b1731f0e92, user_id=3b4702aae20d49a093884e359ae5650a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.508481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.521539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1290/2588] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:31 2022] PUT /identity/v3/projects/0a6ace3f4c114b688cee53b1731f0e92/users/3b4702aae20d49a093884e359ae5650a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:49:31.532473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.532768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.533049 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.546884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:31.564792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] MFA Rules not processed for user `3b4702aae20d49a093884e359ae5650a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:31.566025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:31.632260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1299/2589] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:31.636882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.700178 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70b33e-4c7a-4957-8cf9-ad1c8194c849 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.708971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.709782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.710066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.710342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.711033 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.714092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.736949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:31.747586 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1291/2590] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:31.749591 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.761181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89be146-cd5c-4489-8f08-6aa1c2d057c4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.827293 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.828015 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.828300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.828606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.829329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.831274 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.854744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1300/2591] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:31 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:31.859433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.872345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65808a63-3ebe-4545-b935-dd26ae327172 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.877875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.878725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.879013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.879291 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.880110 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.882502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.896162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1292/2592] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:31.900240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.912717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b12a-a3e8-48fe-8100-b220a4152eb6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:31.917404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:31.918305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:31.918587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:31.918863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] PATH_INFO: `/v3/projects/41c4988f445b4871813932026a01f66f/users/c488719bd84c4f7a86b5ea481a9c889b/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:31.938719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c4988f445b4871813932026a01f66f, user_id=c488719bd84c4f7a86b5ea481a9c889b, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:31.941732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:31.956422 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1301/2593] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:31 2022] PUT /identity/v3/projects/41c4988f445b4871813932026a01f66f/users/c488719bd84c4f7a86b5ea481a9c889b/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:31.960288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:31.970403 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf917d-846b-4542-b6a5-639c9f4e4283 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:32.033970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d056-c173-4395-b40e-8f710a3aa41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:32.034613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d056-c173-4395-b40e-8f710a3aa41d admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.034834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d056-c173-4395-b40e-8f710a3aa41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.038359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d056-c173-4395-b40e-8f710a3aa41d admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.038359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d056-c173-4395-b40e-8f710a3aa41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:32.038359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d056-c173-4395-b40e-8f710a3aa41d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:32.047799 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1293/2594] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:32.052157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:32.066715 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0884-8f4a-4aed-ba7d-b14a619db458 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:32.071465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:32.072352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.072633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.072907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] PATH_INFO: `/v3/projects/41c4988f445b4871813932026a01f66f/users/c488719bd84c4f7a86b5ea481a9c889b/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.075120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c4988f445b4871813932026a01f66f, user_id=c488719bd84c4f7a86b5ea481a9c889b, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:32.078472 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:32.093332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1302/2595] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:32 2022] PUT /identity/v3/projects/41c4988f445b4871813932026a01f66f/users/c488719bd84c4f7a86b5ea481a9c889b/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:32.104085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.104380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.104690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.133800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] MFA Rules not processed for user `c488719bd84c4f7a86b5ea481a9c889b`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:32.134828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:32.211781 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1294/2596] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:32.223412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:32.225117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:32.280678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:32.284724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41235b-9611-48ba-8af1-be47973269d7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:32.289436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:32.290088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.290375 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.290656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.299773 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:32.301214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:32.310676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1303/2597] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:32.387229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:32.396858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089723c6-fa97-4954-ba90-5a1838796330 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:32.400463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d823b-d3fe-43a0-9f23-9842f33eebf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:32.401104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d823b-d3fe-43a0-9f23-9842f33eebf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.401387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d823b-d3fe-43a0-9f23-9842f33eebf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.401665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d823b-d3fe-43a0-9f23-9842f33eebf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.457828 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d823b-d3fe-43a0-9f23-9842f33eebf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:32.459260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d823b-d3fe-43a0-9f23-9842f33eebf4 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:32.468534 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1295/2598] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:32.732537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:32.796731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae21571-b4ac-4813-9e8f-82b00d676d73 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:32.802793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:32.804023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.804523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.804888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] PATH_INFO: `/v3/users/3b4702aae20d49a093884e359ae5650a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.806193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4702aae20d49a093884e359ae5650a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:32.808168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:32.854046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4702aae20d49a093884e359ae5650a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:32.854704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4702aae20d49a093884e359ae5650a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:32.855321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4702aae20d49a093884e359ae5650a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:32.867752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4702aae20d49a093884e359ae5650a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:32.875834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4702aae20d49a093884e359ae5650a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:32.889552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1304/2599] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:32 2022] DELETE /identity/v3/users/3b4702aae20d49a093884e359ae5650a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:32.894151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:32.894446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:32.894728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:32.908438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:32.914814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:32.916059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:32.974355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1296/2600] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:32.984908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:32.986321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:33.043966 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176f0f9-c5da-45d4-9670-ce17d078b9dd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:33.047683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:33.048271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:33.048555 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:33.048830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:33.057695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:33.059119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:33.069115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1305/2601] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:33.329875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:33.331855 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:33.350279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122d248-e079-4a16-9d09-80ee9c1c6343 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:33.355669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:33.356636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:33.356817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:33.357096 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] PATH_INFO: `/v3/projects/0a6ace3f4c114b688cee53b1731f0e92` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:33.358282 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6ace3f4c114b688cee53b1731f0e92)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:33.360223 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:33.406241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6ace3f4c114b688cee53b1731f0e92', 'request_id': 'req-26cc5f9a-8de0-4480-8667-b5fd24c138fa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.413471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6ace3f4c114b688cee53b1731f0e92', 'request_id': 'req-26cc5f9a-8de0-4480-8667-b5fd24c138fa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.419224 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6ace3f4c114b688cee53b1731f0e92', 'request_id': 'req-26cc5f9a-8de0-4480-8667-b5fd24c138fa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.430021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] The token cache is being invalidate because project 0a6ace3f4c114b688cee53b1731f0e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:33.430310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.430943 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.432540 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1297/2602] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:33 2022] DELETE /identity/v3/projects/0a6ace3f4c114b688cee53b1731f0e92 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:33.436640 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:33.446322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1103a-bd29-4aea-8684-87c895a2003e service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:33.455497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:33.503987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:33.504850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:33.505133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:33.505411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] PATH_INFO: `/v3/users/c488719bd84c4f7a86b5ea481a9c889b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:33.506596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c488719bd84c4f7a86b5ea481a9c889b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:33.508541 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:33.560925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c488719bd84c4f7a86b5ea481a9c889b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.561577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c488719bd84c4f7a86b5ea481a9c889b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.562195 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c488719bd84c4f7a86b5ea481a9c889b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.574235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c488719bd84c4f7a86b5ea481a9c889b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.582058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9883d90b-a226-4861-9c18-32ba486da6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c488719bd84c4f7a86b5ea481a9c889b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.594823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1306/2603] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:33 2022] DELETE /identity/v3/users/c488719bd84c4f7a86b5ea481a9c889b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:33.858792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:33.860260 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:33.875373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc5f9a-8de0-4480-8667-b5fd24c138fa admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:33.932994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:33.933870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:33.934157 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:33.934434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] PATH_INFO: `/v3/projects/41c4988f445b4871813932026a01f66f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:33.935640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c4988f445b4871813932026a01f66f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:33.938054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:33.972401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:33.986290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c4988f445b4871813932026a01f66f', 'request_id': 'req-8d6a97a7-b097-4133-b923-4960ee9cdefd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.993158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c4988f445b4871813932026a01f66f', 'request_id': 'req-8d6a97a7-b097-4133-b923-4960ee9cdefd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:33.998703 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c4988f445b4871813932026a01f66f', 'request_id': 'req-8d6a97a7-b097-4133-b923-4960ee9cdefd'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:34.009951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] The token cache is being invalidate because project 41c4988f445b4871813932026a01f66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:34.010237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:34.010870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8d6a97a7-b097-4133-b923-4960ee9cdefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:34.012457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1298/2604] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:33 2022] DELETE /identity/v3/projects/41c4988f445b4871813932026a01f66f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:34.018092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.018386 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.018668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.037871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:34.039068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:34.095870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1307/2605] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:34.159842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.160057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.160321 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.180308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:34.181511 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:34.189962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1299/2606] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:49:34.194227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.204085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e652-29d9-4082-b8f1-44578ae5a591 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.208669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.209321 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.209604 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.209882 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.210609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:34.210915 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.212558 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.224187 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1308/2607] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:34.228610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.238258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7902fd-7aa1-49d3-ab13-7d6ef3c173e9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.242917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.243595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.243901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.244159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.244858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.246747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.273913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1300/2608] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:34.277861 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.287817 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165e535-ed48-49f3-b6b3-0e60e2b103d2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.304957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:34.346562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.347226 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.347553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.347830 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.348537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.350496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.372112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1309/2609] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:34.376776 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.387219 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2df6d-c028-4c68-89e6-9db541fb92fd admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.392136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.392788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.393071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.393345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.394069 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.395699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.409293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1301/2610] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:34.413456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.424002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7de56-fba2-469a-b7bb-45207ef73dd8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.429384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a14b8-a7c2-4c24-ba94-82b4729ccf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.430042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a14b8-a7c2-4c24-ba94-82b4729ccf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.430329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a14b8-a7c2-4c24-ba94-82b4729ccf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.430607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a14b8-a7c2-4c24-ba94-82b4729ccf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.431344 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a14b8-a7c2-4c24-ba94-82b4729ccf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.432978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a14b8-a7c2-4c24-ba94-82b4729ccf3a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.444469 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1310/2611] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:34.448387 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.458402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334c217-ba81-4eba-8f9d-ffc580d88956 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.463041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.464032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.464320 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.464601 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] PATH_INFO: `/v3/projects/a8732eb6f76845a0873bce5cd238dd5a/users/713a6b66c65b4ffcbc07572dc8c05d68/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.480619 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8732eb6f76845a0873bce5cd238dd5a, user_id=713a6b66c65b4ffcbc07572dc8c05d68, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.483245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.496750 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1302/2612] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:34 2022] PUT /identity/v3/projects/a8732eb6f76845a0873bce5cd238dd5a/users/713a6b66c65b4ffcbc07572dc8c05d68/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:34.506766 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.507063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.507341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.536196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] MFA Rules not processed for user `713a6b66c65b4ffcbc07572dc8c05d68`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:34.537417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:34.601542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1311/2613] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:34.606257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.804324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ead6-98fd-4f0a-b610-aeee2a23a915 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.809023 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.809675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.809958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.810234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.810914 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.812933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.840076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1303/2614] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:34.844752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.855515 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4301b-644a-4caf-ad9d-6f5a4a663d21 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.910351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.911018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.911300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.911603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.912299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.914217 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.934202 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1312/2615] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:34 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:34.938279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.948359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22273e10-18a4-48e1-86d0-a8d73b0579de admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.953384 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.954026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.954304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.954577 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:34.955289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:34.956915 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:34.966965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1304/2616] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:34.971544 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:34.981445 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7f818-c03d-4820-a5eb-e6951079cf0f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:34.985957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:34.986820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:34.987100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:34.987374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] PATH_INFO: `/v3/projects/b87607f78139424c9d7f63c6a33c5bd6/users/8cf9be338aa442b581c851cbe9eb21ca/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:35.001933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87607f78139424c9d7f63c6a33c5bd6, user_id=8cf9be338aa442b581c851cbe9eb21ca, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:35.004652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:35.006944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:35.018595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1313/2617] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:34 2022] PUT /identity/v3/projects/b87607f78139424c9d7f63c6a33c5bd6/users/8cf9be338aa442b581c851cbe9eb21ca/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:35.022704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:35.033217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68a00-af18-40e9-bfc2-ef46ce014105 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:35.061365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:35.089850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c78eaa-b516-4ab8-85ac-947824381f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:35.090525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78eaa-b516-4ab8-85ac-947824381f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:35.090793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78eaa-b516-4ab8-85ac-947824381f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:35.091065 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78eaa-b516-4ab8-85ac-947824381f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:35.091827 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c78eaa-b516-4ab8-85ac-947824381f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:35.093413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c78eaa-b516-4ab8-85ac-947824381f34 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:35.103442 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1305/2618] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:35.107553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:35.118216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de39f-5b47-44a6-87cf-a0bb0b938f0a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:35.122724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:35.123628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:35.123910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:35.124742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] PATH_INFO: `/v3/projects/b87607f78139424c9d7f63c6a33c5bd6/users/8cf9be338aa442b581c851cbe9eb21ca/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:35.126725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87607f78139424c9d7f63c6a33c5bd6, user_id=8cf9be338aa442b581c851cbe9eb21ca, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:35.129368 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:35.139258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1314/2619] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:35 2022] PUT /identity/v3/projects/b87607f78139424c9d7f63c6a33c5bd6/users/8cf9be338aa442b581c851cbe9eb21ca/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:35.149580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:35.149870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:35.150148 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:35.177425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] MFA Rules not processed for user `8cf9be338aa442b581c851cbe9eb21ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:35.178639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:35.244797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1306/2620] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:35.255355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:35.257090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:35.315651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e186cc-06e3-4222-8e0a-080c9c53b2c8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:35.319178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:35.319859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:35.320141 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:35.320411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:35.375668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:35.377104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:35.386227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1315/2621] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:39.578962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:39.581597 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:39.608916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68b09c-5f47-4830-8285-fdf4e417a6dc None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:39.614818 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:39.615519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:39.615792 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:39.616071 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:39.625936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:39.628101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:39.638073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1307/2622] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:42.009282 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:42.010876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:42.127140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3795e78-386c-4202-8876-b926fa79ff58 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:42.134499 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:42.135799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:42.135799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:42.135799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:42.139371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:42.153076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:42.154907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38858e1f-e189-44ae-9cfa-9dcbb3f3b284 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:42.168326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1316/2623] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:44.523116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:44.584716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d61aa-288a-4d7b-81b1-77a228e2df90 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:44.589171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:44.590029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:44.590310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:44.590583 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] PATH_INFO: `/v3/users/713a6b66c65b4ffcbc07572dc8c05d68` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:44.591773 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=713a6b66c65b4ffcbc07572dc8c05d68)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:44.593666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:44.633949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:44.639415 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713a6b66c65b4ffcbc07572dc8c05d68'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:44.640158 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713a6b66c65b4ffcbc07572dc8c05d68'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:44.641117 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713a6b66c65b4ffcbc07572dc8c05d68'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:44.652771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713a6b66c65b4ffcbc07572dc8c05d68'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:44.659465 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713a6b66c65b4ffcbc07572dc8c05d68'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:44.671456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1308/2624] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:44 2022] DELETE /identity/v3/users/713a6b66c65b4ffcbc07572dc8c05d68 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:44.676607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:44.677085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:44.677184 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:44.696241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:44.697431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:44.709621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:44.756252 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1317/2625] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:44.765832 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:44.767229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:44.823817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e5b2-b97a-43fb-8e34-67871d23b72b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:44.827453 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:44.828090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:44.828370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:44.828642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:44.837389 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:44.838808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:44.848365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1309/2626] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:45.137361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:45.138655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:45.151487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431bd48-d58a-4634-a914-166617f28cdf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:45.156493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:45.157268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:45.157598 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:45.157864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] PATH_INFO: `/v3/projects/a8732eb6f76845a0873bce5cd238dd5a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:45.159821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8732eb6f76845a0873bce5cd238dd5a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:45.161978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:45.210026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8732eb6f76845a0873bce5cd238dd5a', 'request_id': 'req-aa0553d4-d336-4e5f-8053-4def055efeae'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.217795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8732eb6f76845a0873bce5cd238dd5a', 'request_id': 'req-aa0553d4-d336-4e5f-8053-4def055efeae'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.225062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8732eb6f76845a0873bce5cd238dd5a', 'request_id': 'req-aa0553d4-d336-4e5f-8053-4def055efeae'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.237172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] The token cache is being invalidate because project a8732eb6f76845a0873bce5cd238dd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:45.237636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.238277 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.239891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1318/2627] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:45 2022] DELETE /identity/v3/projects/a8732eb6f76845a0873bce5cd238dd5a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:45.245306 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:45.255176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378301cc-ca0c-4f44-99ef-4eb622448553 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:45.310566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:45.311362 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:45.311676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:45.311954 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] PATH_INFO: `/v3/users/8cf9be338aa442b581c851cbe9eb21ca` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:45.313160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf9be338aa442b581c851cbe9eb21ca)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:45.315063 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:45.359057 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf9be338aa442b581c851cbe9eb21ca'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.359722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf9be338aa442b581c851cbe9eb21ca'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.360326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf9be338aa442b581c851cbe9eb21ca'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.371958 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:45.373176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf9be338aa442b581c851cbe9eb21ca'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.381932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d31fa599-4d5e-4315-8ad9-5a44f11506c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf9be338aa442b581c851cbe9eb21ca'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.396676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1310/2628] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:45 2022] DELETE /identity/v3/users/8cf9be338aa442b581c851cbe9eb21ca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:45.664653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:45.666149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:45.679191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0553d4-d336-4e5f-8053-4def055efeae admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:45.739637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:45.740509 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:45.740793 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:45.741071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] PATH_INFO: `/v3/projects/b87607f78139424c9d7f63c6a33c5bd6` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:45.742246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87607f78139424c9d7f63c6a33c5bd6)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:45.744256 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:45.787907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:45.790910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87607f78139424c9d7f63c6a33c5bd6', 'request_id': 'req-b2f99535-36fb-4152-b8e3-54c036c869c5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.798913 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87607f78139424c9d7f63c6a33c5bd6', 'request_id': 'req-b2f99535-36fb-4152-b8e3-54c036c869c5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.804700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87607f78139424c9d7f63c6a33c5bd6', 'request_id': 'req-b2f99535-36fb-4152-b8e3-54c036c869c5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.816376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] The token cache is being invalidate because project b87607f78139424c9d7f63c6a33c5bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:45.816656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.817270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2f99535-36fb-4152-b8e3-54c036c869c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:45.818785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1319/2629] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:45 2022] DELETE /identity/v3/projects/b87607f78139424c9d7f63c6a33c5bd6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:45.824712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:45.825171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:45.825438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:45.853147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:45.854273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:45.912490 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1311/2630] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:45.920762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:45.921050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:45.921330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:45.940899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:45.942085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:45.949831 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1320/2631] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:45.953853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:45.963782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50ea48-3f8b-4fb3-99f1-49fcff06ea7e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:45.968234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:45.968874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:45.969154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:45.969425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:45.970257 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:45.970594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:45.972215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:45.983726 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1312/2632] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:45.988446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:45.997864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d151-1eff-4e07-9948-c3ab408c41d4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.003181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.003873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.004161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.004441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.005142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.007045 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.033433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1321/2633] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:45 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:46.037660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.047659 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e37ae-0b44-4841-92f0-8baffcb6d9ca admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.103731 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.104422 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.104712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.104990 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.105686 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.107698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.135273 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1313/2634] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:46 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:46.136534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.148573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144b43-7bb9-417e-96fd-8990b5b8100b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.153275 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.156040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.156040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.156040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.156040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.158595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.165454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.167154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:46.169434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1322/2635] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:46.172852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.183242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004b1f-8095-45fa-bb0b-f15919105ca0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.187869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.188506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.188785 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.189063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.190383 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.192001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.201846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1323/2636] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:49:46.205888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.215433 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f025be-a067-4dce-92a9-1cfae448fcd3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.220284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628f750-d9dd-4a12-94f7-6bb41592f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.221175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628f750-d9dd-4a12-94f7-6bb41592f92f admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.221532 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628f750-d9dd-4a12-94f7-6bb41592f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.221723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628f750-d9dd-4a12-94f7-6bb41592f92f admin admin] PATH_INFO: `/v3/projects/6bfa305ca2394b5ea4d1b110d88092e7/users/3955b6b7bae549679358a3a1e72d9a71/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.227630 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8af4c3-918c-42e9-aae5-1580dcad1571 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.231228 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.231897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.232252 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.232425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.234217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:46.237281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628f750-d9dd-4a12-94f7-6bb41592f92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfa305ca2394b5ea4d1b110d88092e7, user_id=3955b6b7bae549679358a3a1e72d9a71, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.239978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628f750-d9dd-4a12-94f7-6bb41592f92f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.247663 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.249109 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.254872 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:46.255791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1324/2637] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:46 2022] PUT /identity/v3/projects/6bfa305ca2394b5ea4d1b110d88092e7/users/3955b6b7bae549679358a3a1e72d9a71/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:49:46.260174 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1314/2638] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:49:46.267476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.267722 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.269294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.295881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] MFA Rules not processed for user `3955b6b7bae549679358a3a1e72d9a71`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:46.297094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:46.492059 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1325/2639] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:46.503528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.504947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:46.566343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbbee2-f4f7-4b10-be9b-d1d0050618d5 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.617684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb51081-75ef-49ac-a680-1747fc2fdb04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.618328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb51081-75ef-49ac-a680-1747fc2fdb04 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.618609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb51081-75ef-49ac-a680-1747fc2fdb04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.618882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb51081-75ef-49ac-a680-1747fc2fdb04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.627896 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb51081-75ef-49ac-a680-1747fc2fdb04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.629330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb51081-75ef-49ac-a680-1747fc2fdb04 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.640052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1315/2640] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:46.659850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.716961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:46.738104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9bafb-2779-4a8c-9088-5afdb936cd47 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:46.744685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:46.745583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.745925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.746200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] PATH_INFO: `/v3/users/3955b6b7bae549679358a3a1e72d9a71` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.747498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3955b6b7bae549679358a3a1e72d9a71)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:46.749420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:46.799790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3955b6b7bae549679358a3a1e72d9a71'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:46.800444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3955b6b7bae549679358a3a1e72d9a71'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:46.801043 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3955b6b7bae549679358a3a1e72d9a71'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:46.813077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3955b6b7bae549679358a3a1e72d9a71'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:46.820435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3955b6b7bae549679358a3a1e72d9a71'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:46.835303 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1326/2641] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:46 2022] DELETE /identity/v3/users/3955b6b7bae549679358a3a1e72d9a71 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:46.840126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:46.840626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:46.840879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:46.865313 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:46.866645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:46.934972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1316/2642] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:46.945588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:46.947352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:47.031310 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9232e-74b3-4cd3-97fe-2a344a546b6a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:47.038244 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77e119-aa07-4892-980e-b15248d59864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:47.039196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77e119-aa07-4892-980e-b15248d59864 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:47.039647 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77e119-aa07-4892-980e-b15248d59864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:47.040050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77e119-aa07-4892-980e-b15248d59864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:47.054554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77e119-aa07-4892-980e-b15248d59864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:47.059749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77e119-aa07-4892-980e-b15248d59864 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:47.074376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1327/2643] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:47.676454 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:47.678584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:47.692535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae40c2-e8c2-4483-91a0-c1f8f839dd65 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:47.697754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:47.698881 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:47.699238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:47.699614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] PATH_INFO: `/v3/projects/6bfa305ca2394b5ea4d1b110d88092e7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:47.700945 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfa305ca2394b5ea4d1b110d88092e7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:47.702933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:47.782425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfa305ca2394b5ea4d1b110d88092e7', 'request_id': 'req-d538eff9-91d8-446d-a6bc-5e2d565801aa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:47.788213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:47.794498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfa305ca2394b5ea4d1b110d88092e7', 'request_id': 'req-d538eff9-91d8-446d-a6bc-5e2d565801aa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:47.806605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfa305ca2394b5ea4d1b110d88092e7', 'request_id': 'req-d538eff9-91d8-446d-a6bc-5e2d565801aa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:47.823056 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] The token cache is being invalidate because project 6bfa305ca2394b5ea4d1b110d88092e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:47.823699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:47.824579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d538eff9-91d8-446d-a6bc-5e2d565801aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:47.826779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1317/2644] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:47 2022] DELETE /identity/v3/projects/6bfa305ca2394b5ea4d1b110d88092e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:47.834330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:47.835211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:47.835211 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:47.862042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:47.863261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:47.941474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1328/2645] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:47.950336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:47.950890 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:47.951227 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:47.971710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:47.972947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:47.986707 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1318/2646] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:47.991859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.010352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1510-9bcb-4ad6-9d72-b484e3855f75 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.016894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.017587 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.017868 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.018142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.018891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:48.019258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.020873 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.030169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:48.040550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1329/2647] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:48.042397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.060756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400ffab-fdc4-41f8-8d2c-df4c3c955638 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.069374 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.070584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.071115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.071669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.073048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.076950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.133779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1319/2648] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:48 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:48.137866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.161354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540b3b-f459-467e-b874-9d0031a85145 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.265357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.266493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.266988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.267980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.269153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.271658 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.303471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.316850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1330/2649] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:48 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:48.318632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2940e-3d29-4c65-beb2-d60ff7e5b71d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.332480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.333296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.333584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.333856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.334585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.336290 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.351450 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1320/2650] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:48.353686 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.364267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d093b-0d3f-4290-9b23-aef515ce3f7d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.371634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7e6ae-c68e-4e93-b8ce-c4d2e88b769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.372652 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7e6ae-c68e-4e93-b8ce-c4d2e88b769f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.373063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7e6ae-c68e-4e93-b8ce-c4d2e88b769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.374130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7e6ae-c68e-4e93-b8ce-c4d2e88b769f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.374738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7e6ae-c68e-4e93-b8ce-c4d2e88b769f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.377651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7e6ae-c68e-4e93-b8ce-c4d2e88b769f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.403996 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1331/2651] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:48.409632 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.427683 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa44d1-943b-44f3-bca0-a8e169d6bfe6 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.436171 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.438351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.438877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.439432 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] PATH_INFO: `/v3/projects/d1dd5afc137b40149ec0d2597270ba9f/users/f541f624aa10419cbbedc508b3fc6fb5/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.472281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dd5afc137b40149ec0d2597270ba9f, user_id=f541f624aa10419cbbedc508b3fc6fb5, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.475112 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.489609 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1321/2652] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:48 2022] PUT /identity/v3/projects/d1dd5afc137b40149ec0d2597270ba9f/users/f541f624aa10419cbbedc508b3fc6fb5/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:48.499799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.500172 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.500522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.537889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] MFA Rules not processed for user `f541f624aa10419cbbedc508b3fc6fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:48.539759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:48.645954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1332/2653] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:48.650546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.714214 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f1ba-8d77-4049-95e7-9af77a07e73e admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.719035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.719725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.720015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.720294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.721073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.722936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.750480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1322/2654] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:48 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:48.755039 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.767118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b1b9f-72e7-4a86-a033-e817c8a2b001 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.833953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.834729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.835288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.835288 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.836129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.841144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.859042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:48.881254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1333/2655] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:48 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:48.882364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.897120 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0fb5-5f07-47a3-8d04-3214a1113d67 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.902793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.903510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.905440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.905440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.905440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.906751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.920502 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1323/2656] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:48.924846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.935841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981e94-3863-449c-bcf2-b4ab219768aa admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.941209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbb310-9df4-4939-be34-a362a77d718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.941877 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbb310-9df4-4939-be34-a362a77d718f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.942160 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbb310-9df4-4939-be34-a362a77d718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.942434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbb310-9df4-4939-be34-a362a77d718f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.943167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbb310-9df4-4939-be34-a362a77d718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:48.944837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbb310-9df4-4939-be34-a362a77d718f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:48.956238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1334/2657] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:48.960944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:48.971783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a145-b65a-41f4-b35b-522cc5902029 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:48.977127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:48.978351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:48.978639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:48.978916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] PATH_INFO: `/v3/projects/a12ff119d9a84b6ebedae991f9a4245d/users/8cbf7bc72d4b4d4d8f80125f50f9afc7/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:48.997557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12ff119d9a84b6ebedae991f9a4245d, user_id=8cbf7bc72d4b4d4d8f80125f50f9afc7, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.000236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.014340 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1324/2658] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:48 2022] PUT /identity/v3/projects/a12ff119d9a84b6ebedae991f9a4245d/users/8cbf7bc72d4b4d4d8f80125f50f9afc7/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:49:49.024717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.025010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.025292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.056980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] MFA Rules not processed for user `8cbf7bc72d4b4d4d8f80125f50f9afc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:49.058628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:49.156077 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1335/2659] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:49.160851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.197296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:49.239992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec83396-951a-484d-ade6-ab813d4d4769 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.246740 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.247606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.247973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.248373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.249103 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.251022 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.296930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1325/2660] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:49 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:49.298987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.314149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599d5a-fe3f-4fed-acf5-e55dee7bbab1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.392633 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.393930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.394429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.394917 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.395683 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.397636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.428361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1336/2661] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:49 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:49.433350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.448516 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c53a1a-5266-4cf0-a2c9-9e695dcd50e2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.457241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.458029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.458428 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.458767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.459651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.461322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.474900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1326/2662] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:49.479710 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.501361 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb329b1-0255-41ed-970c-5a455252efe3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.506953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.508225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.508590 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.508943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] PATH_INFO: `/v3/projects/c8edfaeeb13547d480f2699c9bb5629b/users/5c22f7f23f7044f9af1378b0ee690bcc/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.538254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8edfaeeb13547d480f2699c9bb5629b, user_id=5c22f7f23f7044f9af1378b0ee690bcc, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.541193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.571887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1337/2663] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:49 2022] PUT /identity/v3/projects/c8edfaeeb13547d480f2699c9bb5629b/users/5c22f7f23f7044f9af1378b0ee690bcc/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:49.573143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.591430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762f74-0d63-4d01-81c7-f4171098a179 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.675737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.676416 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.676700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.676978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.677709 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.679366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.691694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.691858 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1327/2664] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:49.695614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.695763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:49.706331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce763a03-2b4d-4f24-a5fe-2871170b95a4 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.711152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292104c-b6ef-4f89-842b-b2c2ef164ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.712083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292104c-b6ef-4f89-842b-b2c2ef164ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.712452 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292104c-b6ef-4f89-842b-b2c2ef164ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.712734 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292104c-b6ef-4f89-842b-b2c2ef164ebf admin admin] PATH_INFO: `/v3/projects/c8edfaeeb13547d480f2699c9bb5629b/users/5c22f7f23f7044f9af1378b0ee690bcc/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.715471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292104c-b6ef-4f89-842b-b2c2ef164ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8edfaeeb13547d480f2699c9bb5629b, user_id=5c22f7f23f7044f9af1378b0ee690bcc, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.718407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292104c-b6ef-4f89-842b-b2c2ef164ebf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.732123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1328/2665] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:49 2022] PUT /identity/v3/projects/c8edfaeeb13547d480f2699c9bb5629b/users/5c22f7f23f7044f9af1378b0ee690bcc/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:49:49.745457 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.746003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.746316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.751767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:49.789261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] MFA Rules not processed for user `5c22f7f23f7044f9af1378b0ee690bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:49.789527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fe9d2-7319-41be-944c-a44a9a29c510 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.790493 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:49.870351 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1329/2666] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:49.871575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.872933 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:49.877518 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.879001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.879371 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.879759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.881998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:49.886644 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:49.897005 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.898601 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.909795 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1338/2667] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:49:49.912468 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:49.913848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:49.946956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d1bda-eab3-417e-b1f5-aea0941c4d05 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.952061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.953026 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.953312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.953590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] PATH_INFO: `/v3/users/bd434ec0ff3649998b7daa1bfd4dd4b0` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:49.955344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd434ec0ff3649998b7daa1bfd4dd4b0)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:49.957341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:49.977190 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb81e7-6559-4c84-8f25-4931723f20d9 service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:49.980978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603902d-5e77-494b-b395-912ee11daa3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:49.981645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603902d-5e77-494b-b395-912ee11daa3d service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:49.981926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603902d-5e77-494b-b395-912ee11daa3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:49.982248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603902d-5e77-494b-b395-912ee11daa3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.008189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd434ec0ff3649998b7daa1bfd4dd4b0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.008864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd434ec0ff3649998b7daa1bfd4dd4b0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.009477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd434ec0ff3649998b7daa1bfd4dd4b0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.023301 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd434ec0ff3649998b7daa1bfd4dd4b0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.030102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd434ec0ff3649998b7daa1bfd4dd4b0'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.044318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1330/2668] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:49 2022] DELETE /identity/v3/users/bd434ec0ff3649998b7daa1bfd4dd4b0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:50.052281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603902d-5e77-494b-b395-912ee11daa3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.053731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603902d-5e77-494b-b395-912ee11daa3d service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.063549 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1339/2669] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:50.266719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.268382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:50.359808 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80de24-886c-4b69-8d04-4a59490d8cfe admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.367153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.368099 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.368348 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.368621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] PATH_INFO: `/v3/projects/566ed8d590cd478081bc174a783956cf` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.369860 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566ed8d590cd478081bc174a783956cf)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.371816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.432869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:50.452259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566ed8d590cd478081bc174a783956cf', 'request_id': 'req-9604f747-5b42-4d6d-98b9-69c735423602'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.460093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566ed8d590cd478081bc174a783956cf', 'request_id': 'req-9604f747-5b42-4d6d-98b9-69c735423602'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.466823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566ed8d590cd478081bc174a783956cf', 'request_id': 'req-9604f747-5b42-4d6d-98b9-69c735423602'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.479147 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] The token cache is being invalidate because project 566ed8d590cd478081bc174a783956cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:50.479470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.480123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-9604f747-5b42-4d6d-98b9-69c735423602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:50.481646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1331/2670] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:50 2022] DELETE /identity/v3/projects/566ed8d590cd478081bc174a783956cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:49:50.487326 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.487649 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.488010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.507853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:50.509040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:50.529307 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:50.572655 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1340/2671] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:50.581384 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.581674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.581952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.601162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:50.602610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:50.610427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1332/2672] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:50.615167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.625092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6845e5-6f2a-41da-98e9-7a74723961a2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.630397 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.631061 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.631343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.631728 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.632626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:50.633032 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.634909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.647100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1341/2673] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:50.652067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.661234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e5c1-cc25-4f8f-8485-d046db85a53c None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.665879 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.666527 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.666811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.667084 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.667834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.669817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.698969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1333/2674] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:50 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:49:50.703092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.713107 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca8479-ee02-4fce-964c-ced1f370113d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.769222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.769886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.770171 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.770446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.771129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.773090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.793475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1342/2675] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:50 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:50.797727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.808617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53d99-aa06-4c9a-b509-d465bd155a07 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.813364 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.814031 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.814867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.815146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.815908 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.817523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.827469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1334/2676] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:50.831459 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.842924 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec429f2-b63c-4b62-a742-db680ef66401 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.848454 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88994-3732-4903-815d-8e5a7f61a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.849286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88994-3732-4903-815d-8e5a7f61a17d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.849566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88994-3732-4903-815d-8e5a7f61a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.849842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88994-3732-4903-815d-8e5a7f61a17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.850567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e88994-3732-4903-815d-8e5a7f61a17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.852631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e88994-3732-4903-815d-8e5a7f61a17d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.863853 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1343/2677] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:50.868275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:50.878927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df8be-4b66-4fd1-95c1-a1ecc84fbcfd admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:50.883458 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:50.884329 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.884610 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.884882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] PATH_INFO: `/v3/projects/a6e221099bc54ec9a8ac082d7753ba4f/users/f5c67c1a005d47a8b4ece6dba601c0fe/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.899626 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e221099bc54ec9a8ac082d7753ba4f, user_id=f5c67c1a005d47a8b4ece6dba601c0fe, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:50.902392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:50.915357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1335/2678] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:50 2022] PUT /identity/v3/projects/a6e221099bc54ec9a8ac082d7753ba4f/users/f5c67c1a005d47a8b4ece6dba601c0fe/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:50.926382 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:50.926933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:50.927104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:50.958916 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] MFA Rules not processed for user `f5c67c1a005d47a8b4ece6dba601c0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:50.960189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:51.023000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1344/2679] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:51.035618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:51.037304 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:51.108670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67072a-b212-4825-bc33-9a46912b1af7 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:51.114851 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbe81-c5f8-44f5-aa73-b2b958acffd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17968a13a13d4ad49956f1276256e8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:51.115522 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbe81-c5f8-44f5-aa73-b2b958acffd7 service nova] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:51.115806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbe81-c5f8-44f5-aa73-b2b958acffd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:51.116083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbe81-c5f8-44f5-aa73-b2b958acffd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:51.123662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbe81-c5f8-44f5-aa73-b2b958acffd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:51.125231 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbe81-c5f8-44f5-aa73-b2b958acffd7 service nova] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:51.134010 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1336/2680] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:51.344619 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:51.370008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:51.414206 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe8e48-29ab-413d-9e8f-e53c06482184 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:51.420662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:51.421997 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:51.422486 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:51.422909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] PATH_INFO: `/v3/users/f5c67c1a005d47a8b4ece6dba601c0fe` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:51.424834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c67c1a005d47a8b4ece6dba601c0fe)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:51.428464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:51.482975 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c67c1a005d47a8b4ece6dba601c0fe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:51.483704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c67c1a005d47a8b4ece6dba601c0fe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:51.484363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c67c1a005d47a8b4ece6dba601c0fe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:51.498234 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c67c1a005d47a8b4ece6dba601c0fe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:51.506163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c67c1a005d47a8b4ece6dba601c0fe'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:51.520706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1345/2681] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:51 2022] DELETE /identity/v3/users/f5c67c1a005d47a8b4ece6dba601c0fe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:51.524294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:51.524721 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:51.525012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:51.545225 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:51.546689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:51.593427 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:51.617889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1337/2682] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:51.629340 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:51.630756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:51.659250 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:51.660666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:51.690865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93030-e184-4d07-8506-c4c8f6d5ad25 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:51.694473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:51.695118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:51.695415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:51.695704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:51.705545 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:51.707050 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:51.716711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1346/2683] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:51.718813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61451707-c351-4d30-8e9e-f58da2f30804 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:51.722553 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:51.723278 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:51.723661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:51.723940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:51.725704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:51.787745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:51.789366 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5ff5-4089-4aa3-a01d-d28e1a90ce3b service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:51.802151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1338/2684] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:49:52.027410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.029247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.042801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276c40-33b1-4cba-971c-b4c5f238a815 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.049213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.050704 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.051656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.052068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] PATH_INFO: `/v3/projects/a6e221099bc54ec9a8ac082d7753ba4f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.053989 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e221099bc54ec9a8ac082d7753ba4f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.057352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.112157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:52.121402 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e221099bc54ec9a8ac082d7753ba4f', 'request_id': 'req-6269f19b-966f-4f4f-a527-0973fe3f96a7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:52.132537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e221099bc54ec9a8ac082d7753ba4f', 'request_id': 'req-6269f19b-966f-4f4f-a527-0973fe3f96a7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:52.138620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e221099bc54ec9a8ac082d7753ba4f', 'request_id': 'req-6269f19b-966f-4f4f-a527-0973fe3f96a7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:52.151668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] The token cache is being invalidate because project a6e221099bc54ec9a8ac082d7753ba4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:52.152201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:52.153026 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6269f19b-966f-4f4f-a527-0973fe3f96a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:52.154838 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1347/2685] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:52 2022] DELETE /identity/v3/projects/a6e221099bc54ec9a8ac082d7753ba4f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:52.162261 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.162779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.162902 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.191359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:52.192604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.259646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1339/2686] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:52.270034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.270034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.270034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.288744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:52.289961 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.297994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1348/2687] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:49:52.302901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.313421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e6d5f-544c-4e7e-bc5d-bc604c6f2733 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.321693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.322381 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.322690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.322965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.323739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:49:52.324049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.325645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.341563 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1340/2688] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:49:52.342769 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.352628 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ecdd9-97ae-4309-afae-91bc4423b893 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.357416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.358069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.358347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.358620 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.359336 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.361875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.393742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1349/2689] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:49:52 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:52.395783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.405616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.407210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b10c56-6a0a-465d-8820-d552a2f11c75 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.407606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.434848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:52.466720 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced021-e899-4d59-bf09-af49ca4ef076 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.467986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.468664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.468948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.469226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.469939 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.471023 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.471699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.471980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.472251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.472404 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.474076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.502207 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1341/2690] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:49:52 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:49:52.506523 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.516288 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48d3a-7418-4f72-974a-e249793d6aef admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.520961 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.521646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.521935 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.522215 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.522949 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.524599 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.536030 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1342/2691] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:49:52.540003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.546891 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.549148 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.554785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9725-3c6d-4fc8-bcf4-ffacdb5f3638 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.560274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155c764-c49a-4040-b32c-7a264404097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.561008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c764-c49a-4040-b32c-7a264404097c admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.561134 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1350/2692] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:49:52.561560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c764-c49a-4040-b32c-7a264404097c admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.561916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c764-c49a-4040-b32c-7a264404097c admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.562728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155c764-c49a-4040-b32c-7a264404097c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.564402 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155c764-c49a-4040-b32c-7a264404097c admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.579430 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1343/2693] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:49:52.581435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.592901 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfaca1-6e26-4565-a30e-c7323fafad58 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.598526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.599474 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.599767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.600066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] PATH_INFO: `/v3/projects/0633a7c9f49b4c8990f83181167402bd/users/ed5663daad184eb895803020a117bced/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.616810 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0633a7c9f49b4c8990f83181167402bd, user_id=ed5663daad184eb895803020a117bced, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.619792 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.634693 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1351/2694] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:49:52 2022] PUT /identity/v3/projects/0633a7c9f49b4c8990f83181167402bd/users/ed5663daad184eb895803020a117bced/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:52.646392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.646712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.647143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.678195 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] MFA Rules not processed for user `ed5663daad184eb895803020a117bced`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:52.679440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.749705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1344/2695] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:52.762181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:52.764014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:52.794504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:52.835064 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40232-b697-485c-84f5-84bcdca79419 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:52.838779 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41341-53e6-4a51-944f-c52307686541 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a758c6680078465d8d65ffd105594530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:52.839457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41341-53e6-4a51-944f-c52307686541 service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:52.839741 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41341-53e6-4a51-944f-c52307686541 service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:52.840017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41341-53e6-4a51-944f-c52307686541 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:52.850284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded41341-53e6-4a51-944f-c52307686541 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:52.852276 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded41341-53e6-4a51-944f-c52307686541 service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:52.861754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1352/2696] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:56.622156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:56.623627 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:56.695397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6d2a5-712c-41e6-a8e4-62de6abfbd01 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:56.699919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:56.700787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:56.701067 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:56.701341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] PATH_INFO: `/v3/users/f541f624aa10419cbbedc508b3fc6fb5` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:56.702514 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f541f624aa10419cbbedc508b3fc6fb5)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:56.704456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:56.727358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:56.751443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f541f624aa10419cbbedc508b3fc6fb5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:56.752095 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f541f624aa10419cbbedc508b3fc6fb5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:56.752701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f541f624aa10419cbbedc508b3fc6fb5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:56.765289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f541f624aa10419cbbedc508b3fc6fb5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:56.775175 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f541f624aa10419cbbedc508b3fc6fb5'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:56.790925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1345/2697] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:56 2022] DELETE /identity/v3/users/f541f624aa10419cbbedc508b3fc6fb5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:56.795602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:56.796104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:56.796221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:56.815942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:49:56.817155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:56.878083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1353/2698] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:49:56.888208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:56.889660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:56.947976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996017c9-36e2-443e-a06d-229a31675c7d admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:56.953242 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:56.954440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:56.955617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:56.956105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:56.970738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:56.972433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:56.983431 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1346/2699] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:49:57.262688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:57.264196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:57.276255 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30367-a913-45a2-b894-560f9cf61eb3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:57.280918 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:57.281980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:57.282285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:57.282656 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] PATH_INFO: `/v3/projects/d1dd5afc137b40149ec0d2597270ba9f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:57.283962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1dd5afc137b40149ec0d2597270ba9f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:57.285952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:57.347581 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1dd5afc137b40149ec0d2597270ba9f', 'request_id': 'req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.355562 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1dd5afc137b40149ec0d2597270ba9f', 'request_id': 'req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.361738 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1dd5afc137b40149ec0d2597270ba9f', 'request_id': 'req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.372627 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] The token cache is being invalidate because project d1dd5afc137b40149ec0d2597270ba9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:57.372910 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.373540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.375067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1354/2700] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:57 2022] DELETE /identity/v3/projects/d1dd5afc137b40149ec0d2597270ba9f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:57.379739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:57.389940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bbe8b-7f55-4b5e-aeff-e80844136d9e service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:57.446820 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:57.447723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:57.448008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:57.448312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] PATH_INFO: `/v3/users/8cbf7bc72d4b4d4d8f80125f50f9afc7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:57.449499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbf7bc72d4b4d4d8f80125f50f9afc7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:57.451440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:57.495046 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:57.496671 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbf7bc72d4b4d4d8f80125f50f9afc7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.497455 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbf7bc72d4b4d4d8f80125f50f9afc7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.498560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbf7bc72d4b4d4d8f80125f50f9afc7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.516002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbf7bc72d4b4d4d8f80125f50f9afc7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.524373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbf7bc72d4b4d4d8f80125f50f9afc7'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:57.546539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1347/2701] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:57 2022] DELETE /identity/v3/users/8cbf7bc72d4b4d4d8f80125f50f9afc7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:57.850158 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:57.852378 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:57.869589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2c3d-8a90-4a44-ad9e-d3f4196e9876 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:57.942254 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:57.954977 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:57.956100 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:57.956616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:57.957168 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] PATH_INFO: `/v3/projects/a12ff119d9a84b6ebedae991f9a4245d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:57.958512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12ff119d9a84b6ebedae991f9a4245d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:57.960534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:58.009599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12ff119d9a84b6ebedae991f9a4245d', 'request_id': 'req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.018268 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12ff119d9a84b6ebedae991f9a4245d', 'request_id': 'req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.024105 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12ff119d9a84b6ebedae991f9a4245d', 'request_id': 'req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.037677 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] The token cache is being invalidate because project a12ff119d9a84b6ebedae991f9a4245d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:58.038018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.038713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.040416 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1355/2702] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:57 2022] DELETE /identity/v3/projects/a12ff119d9a84b6ebedae991f9a4245d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:58.045575 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:58.047443 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:58.062643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c86a-2034-4143-94e8-409a4137efda admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:58.119770 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:58.120572 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:58.120857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:58.121426 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] PATH_INFO: `/v3/users/5c22f7f23f7044f9af1378b0ee690bcc` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:58.122352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c22f7f23f7044f9af1378b0ee690bcc)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:58.124303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:58.179704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c22f7f23f7044f9af1378b0ee690bcc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.180501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c22f7f23f7044f9af1378b0ee690bcc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.181188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c22f7f23f7044f9af1378b0ee690bcc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.195149 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c22f7f23f7044f9af1378b0ee690bcc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.208172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c22f7f23f7044f9af1378b0ee690bcc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.224846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1348/2703] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:49:58 2022] DELETE /identity/v3/users/5c22f7f23f7044f9af1378b0ee690bcc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:49:58.543727 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:49:58.545221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:49:58.566241 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d5b5-76aa-46e1-bfd0-42bb2cbeabd9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:49:58.629193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:49:58.630067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:49:58.630352 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:49:58.630629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] PATH_INFO: `/v3/projects/c8edfaeeb13547d480f2699c9bb5629b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:49:58.631893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8edfaeeb13547d480f2699c9bb5629b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:49:58.633789 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:49:58.679561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8edfaeeb13547d480f2699c9bb5629b', 'request_id': 'req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.686742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8edfaeeb13547d480f2699c9bb5629b', 'request_id': 'req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.692911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8edfaeeb13547d480f2699c9bb5629b', 'request_id': 'req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.703923 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] The token cache is being invalidate because project c8edfaeeb13547d480f2699c9bb5629b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:49:58.704210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.705465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6e8fc3f4-ac2d-4a45-998b-919ca3fc37b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:49:58.707125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1356/2704] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:49:58 2022] DELETE /identity/v3/projects/c8edfaeeb13547d480f2699c9bb5629b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:08.220647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:08.700886 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=79,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:15.682845 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:15.689277 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:15.702172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae1785-33fb-43a9-9859-528691b480d5 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:15.768238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:15.769199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:15.769487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:15.769765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] PATH_INFO: `/v3/users/ed5663daad184eb895803020a117bced` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:15.770976 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5663daad184eb895803020a117bced)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:15.773035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:15.828852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5663daad184eb895803020a117bced'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.830019 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5663daad184eb895803020a117bced'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.830848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5663daad184eb895803020a117bced'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.849425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5663daad184eb895803020a117bced'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.857047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5663daad184eb895803020a117bced'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.870222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1349/2705] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:15 2022] DELETE /identity/v3/users/ed5663daad184eb895803020a117bced => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:15.875067 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:15.875572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:15.876699 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:15.898053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:15.899351 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:15.975736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1357/2706] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:15.986234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:15.987695 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.049189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbfea3-ef22-497c-83c8-0276821c59f5 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.052755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac309ecd-7e8f-49f9-857d-1c5f818a08cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.053392 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309ecd-7e8f-49f9-857d-1c5f818a08cb service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.053674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309ecd-7e8f-49f9-857d-1c5f818a08cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.053947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309ecd-7e8f-49f9-857d-1c5f818a08cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.063000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac309ecd-7e8f-49f9-857d-1c5f818a08cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.065059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac309ecd-7e8f-49f9-857d-1c5f818a08cb service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.074674 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1350/2707] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:16.375953 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.378079 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.391434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfa9f8-b417-4831-b08e-2ec16fc25ca4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.396768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.397875 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.398396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.398594 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] PATH_INFO: `/v3/projects/0633a7c9f49b4c8990f83181167402bd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.399870 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0633a7c9f49b4c8990f83181167402bd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.401784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.449824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0633a7c9f49b4c8990f83181167402bd', 'request_id': 'req-7c51cb19-7363-43e2-9c5a-9d6437944d4b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.457662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0633a7c9f49b4c8990f83181167402bd', 'request_id': 'req-7c51cb19-7363-43e2-9c5a-9d6437944d4b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.463247 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0633a7c9f49b4c8990f83181167402bd', 'request_id': 'req-7c51cb19-7363-43e2-9c5a-9d6437944d4b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.474893 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] The token cache is being invalidate because project 0633a7c9f49b4c8990f83181167402bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:16.475175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.475844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7c51cb19-7363-43e2-9c5a-9d6437944d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.477636 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1358/2708] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:16 2022] DELETE /identity/v3/projects/0633a7c9f49b4c8990f83181167402bd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:16.482589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703703-63c4-4006-9985-4c124018f1af None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.482886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703703-63c4-4006-9985-4c124018f1af None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.483165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703703-63c4-4006-9985-4c124018f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.502804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-b6703703-63c4-4006-9985-4c124018f1af None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:16.504035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-b6703703-63c4-4006-9985-4c124018f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.521498 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:16.568316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1351/2709] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:16.575990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.576354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.576703 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.596589 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:16.597786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.605890 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1359/2710] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:16.609971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703703-63c4-4006-9985-4c124018f1af None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.620176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703703-63c4-4006-9985-4c124018f1af None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.624713 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.625358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.625639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.625912 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.626625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:16.626926 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.628613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.639981 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1352/2711] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:16.644182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.653287 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe45bc-5962-4470-be66-e5500fab7ba8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.658430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.659078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.659359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.659669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.660355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.662272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.688740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1360/2712] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:16 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:16.692842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.702848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed266-10c3-45e6-a2dc-f8dc4029b7c9 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.758354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.759029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.759308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.759613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.760295 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.762192 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.784074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1353/2713] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:16 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:16.788236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.798676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877ee3-77e3-4267-8637-27124c8d1f77 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.803574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.804232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.804511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.804780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.805503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.807094 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.817068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1361/2714] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:16.821338 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.831920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b131c5-b14f-422a-a3c2-c790ce2054b0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.836558 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b284e-9031-45ba-9473-42dce44012c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.837216 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b284e-9031-45ba-9473-42dce44012c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.837504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b284e-9031-45ba-9473-42dce44012c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.837783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b284e-9031-45ba-9473-42dce44012c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.838509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b284e-9031-45ba-9473-42dce44012c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.840199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b284e-9031-45ba-9473-42dce44012c5 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.851370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1354/2715] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:16.855725 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.865599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b594bcd-47f2-445d-abdd-10dbe5f795e8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.870109 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.871070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.871350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.871651 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] PATH_INFO: `/v3/projects/29f57a6ffd6348d5900b289311436002/users/896e820df6904a2c91bd1a17f405fd08/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.887087 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f57a6ffd6348d5900b289311436002, user_id=896e820df6904a2c91bd1a17f405fd08, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.889749 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.905888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1362/2716] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:16 2022] PUT /identity/v3/projects/29f57a6ffd6348d5900b289311436002/users/896e820df6904a2c91bd1a17f405fd08/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:16.919817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5f236-90e5-4999-9d4c-68380f86fc4f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.920107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5f236-90e5-4999-9d4c-68380f86fc4f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.920382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5f236-90e5-4999-9d4c-68380f86fc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.947489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-46c5f236-90e5-4999-9d4c-68380f86fc4f None None] MFA Rules not processed for user `896e820df6904a2c91bd1a17f405fd08`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:16.948705 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-46c5f236-90e5-4999-9d4c-68380f86fc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:17.011952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1355/2717] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:17.024756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:17.029007 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:17.051151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:17.101222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2349-593b-4328-8303-e904b3f5643b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:17.106135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:17.106809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:17.107096 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:17.107367 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:17.116605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:17.118496 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:17.126869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:17.127156 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:17.127467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:17.130835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1363/2718] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:17.148322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:17.149660 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:17.164810 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:17.213899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1356/2719] 10.222.0.57 () {58 vars in 967 bytes} [Mon Jul 25 08:50:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:17.269128 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:17.270576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:17.353174 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1965b-8dd2-4e27-8d3f-cdb6bb5fe7ca service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:17.358201 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:17.358849 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:17.359126 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:17.359430 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:17.368497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:17.370253 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:17.380068 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1364/2720] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:50:21.050440 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:21.051978 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.133816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0d096-d76c-4157-9cd1-16c6d82556c9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:21.139066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:21.139766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.140051 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.140331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.142694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.154664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:21.156283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:21.167518 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1357/2721] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:24.205985 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.209149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.288815 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee18e-1371-4486-b755-e1ac768e6b5f service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.295035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.296434 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.296740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.297091 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] PATH_INFO: `/v3/users/e923b600825341cea443b6165d8e1456` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.299122 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e923b600825341cea443b6165d8e1456)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.301066 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.370112 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e923b600825341cea443b6165d8e1456'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.370942 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e923b600825341cea443b6165d8e1456'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.371987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e923b600825341cea443b6165d8e1456'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.378593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:24.388596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e923b600825341cea443b6165d8e1456'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.397270 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e923b600825341cea443b6165d8e1456'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.411239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1365/2722] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:24 2022] DELETE /identity/v3/users/e923b600825341cea443b6165d8e1456 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:24.586862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.598897 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9996a-28df-46fa-a03c-2e3a3cca4324 service placement] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.656002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.656868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.657680 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.657956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] PATH_INFO: `/v3/projects/c660a6f1e63d4c0f83ecb3903f26eea7` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.659125 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c660a6f1e63d4c0f83ecb3903f26eea7)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.661048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.712899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c660a6f1e63d4c0f83ecb3903f26eea7', 'request_id': 'req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.716356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:24.721253 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c660a6f1e63d4c0f83ecb3903f26eea7', 'request_id': 'req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.728617 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c660a6f1e63d4c0f83ecb3903f26eea7', 'request_id': 'req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.740699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] The token cache is being invalidate because project c660a6f1e63d4c0f83ecb3903f26eea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:24.740993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.741625 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.743143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1358/2723] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:24 2022] DELETE /identity/v3/projects/c660a6f1e63d4c0f83ecb3903f26eea7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:24.747120 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.748547 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.761721 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bf3ee-ea1d-4438-83c1-f5517be3a92e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.818264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.818927 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.819207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.819519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] PATH_INFO: `/v3/users/641758a62dd8489a8b24e1191d1801eb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.820747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641758a62dd8489a8b24e1191d1801eb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.822695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.869613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641758a62dd8489a8b24e1191d1801eb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.870182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641758a62dd8489a8b24e1191d1801eb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.870925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641758a62dd8489a8b24e1191d1801eb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.882852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641758a62dd8489a8b24e1191d1801eb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.891191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641758a62dd8489a8b24e1191d1801eb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:24.903485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1366/2724] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:24 2022] DELETE /identity/v3/users/641758a62dd8489a8b24e1191d1801eb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:25.075927 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:25.077529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:25.097574 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d766a1-0664-450f-9f49-8d3b7a42fc9f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:25.154399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:25.155180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.155496 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.155771 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] PATH_INFO: `/v3/projects/eae970daca3f4ac2a299aab9543c39cd` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.157102 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae970daca3f4ac2a299aab9543c39cd)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:25.158992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:25.206411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae970daca3f4ac2a299aab9543c39cd', 'request_id': 'req-c7d611eb-7912-4b26-8797-006b4367ddc3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:25.213847 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae970daca3f4ac2a299aab9543c39cd', 'request_id': 'req-c7d611eb-7912-4b26-8797-006b4367ddc3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:25.220037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae970daca3f4ac2a299aab9543c39cd', 'request_id': 'req-c7d611eb-7912-4b26-8797-006b4367ddc3'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:25.231497 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] The token cache is being invalidate because project eae970daca3f4ac2a299aab9543c39cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:25.231788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:25.232434 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c7d611eb-7912-4b26-8797-006b4367ddc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:25.233970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1359/2725] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:25 2022] DELETE /identity/v3/projects/eae970daca3f4ac2a299aab9543c39cd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:34.900110 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:35.228557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:47.858473 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:47.863025 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:47.876350 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea37bf-ca07-40da-a530-0bd3b64775a5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:47.953687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:47.954672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:47.954956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:47.955239 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] PATH_INFO: `/v3/users/896e820df6904a2c91bd1a17f405fd08` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:47.957072 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=896e820df6904a2c91bd1a17f405fd08)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:47.960485 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.028729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896e820df6904a2c91bd1a17f405fd08'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.029519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896e820df6904a2c91bd1a17f405fd08'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.030143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896e820df6904a2c91bd1a17f405fd08'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.044637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896e820df6904a2c91bd1a17f405fd08'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.052754 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896e820df6904a2c91bd1a17f405fd08'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.068876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1367/2726] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:47 2022] DELETE /identity/v3/users/896e820df6904a2c91bd1a17f405fd08 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:48.073552 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.074077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.074180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.094839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:48.095993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.159492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1360/2727] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:48.170078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.171801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.240842 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da524c-0924-43ef-b869-2819c8a9c0ce admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:48.245319 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b699bb-1c23-4704-b58f-f8da1206b670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.246062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b699bb-1c23-4704-b58f-f8da1206b670 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.246343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b699bb-1c23-4704-b58f-f8da1206b670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.246688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b699bb-1c23-4704-b58f-f8da1206b670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.258381 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b699bb-1c23-4704-b58f-f8da1206b670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.259874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b699bb-1c23-4704-b58f-f8da1206b670 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.270602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1368/2728] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:50:48.574230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.575789 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.594461 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25242600-5490-40f3-968b-d8f2a585e756 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:48.603837 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.605045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.605407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.605795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] PATH_INFO: `/v3/projects/29f57a6ffd6348d5900b289311436002` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.607459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f57a6ffd6348d5900b289311436002)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.610167 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.682900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f57a6ffd6348d5900b289311436002', 'request_id': 'req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.693615 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f57a6ffd6348d5900b289311436002', 'request_id': 'req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.701501 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f57a6ffd6348d5900b289311436002', 'request_id': 'req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.716088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] The token cache is being invalidate because project 29f57a6ffd6348d5900b289311436002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:48.716425 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.717262 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1e0a397e-f2c1-459d-9710-44a6ac53ccaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.719199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1361/2729] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:48 2022] DELETE /identity/v3/projects/29f57a6ffd6348d5900b289311436002 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:48.726501 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.727432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.728053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.754150 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:48.756073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.775791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:48.825438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1369/2730] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:48.833700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.834002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.834258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.856817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:48.858002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.868491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1362/2731] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:48.872349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.883503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71bbe-4983-4c71-ba08-1e88eb0639de None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:48.888730 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.889489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.889757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.890041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.890791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:48.891099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.892821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.906401 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1370/2732] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:48.910962 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.922754 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fd98-96c8-42a1-8ba8-d5466f9670d7 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:48.932408 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.933433 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.933761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.934230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.935217 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.937199 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.988107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1363/2733] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:48 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:48.992954 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:49.003435 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073b39-1e39-40fd-9428-fe2ed71ce16f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.099048 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.100421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.101133 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.101718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.103137 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.105330 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.135650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1371/2734] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:48 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:49.139238 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:49.153787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8f77-47f8-4482-826a-6f2777195478 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.166689 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.167531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.167877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.168353 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.169104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.171715 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.191138 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1364/2735] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:49.196576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:49.209337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba362c-9476-452e-ba14-9ebccf7e2f1f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.217932 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02844e-4376-4315-8a18-342b722107aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.218982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02844e-4376-4315-8a18-342b722107aa admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.219322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02844e-4376-4315-8a18-342b722107aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.219682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02844e-4376-4315-8a18-342b722107aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.220578 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02844e-4376-4315-8a18-342b722107aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.222514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02844e-4376-4315-8a18-342b722107aa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.245542 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1372/2736] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:49.246893 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:49.258370 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481547e-0f44-4a85-a966-8456debd18bd admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.263600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.264470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.264913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.264913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] PATH_INFO: `/v3/projects/414788d2798641739975c1e657e240f5/users/bc3e07a089f643c994dea7e0301b25bb/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.282197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] RBAC: Authorizing `identity:create_grant(project_id=414788d2798641739975c1e657e240f5, user_id=bc3e07a089f643c994dea7e0301b25bb, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.285477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.302267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1365/2737] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:49 2022] PUT /identity/v3/projects/414788d2798641739975c1e657e240f5/users/bc3e07a089f643c994dea7e0301b25bb/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:49.314448 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b0f5f-98b7-4c20-8de9-cfeb532dd694 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.314740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b0f5f-98b7-4c20-8de9-cfeb532dd694 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.315017 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b0f5f-98b7-4c20-8de9-cfeb532dd694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.346099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ab9b0f5f-98b7-4c20-8de9-cfeb532dd694 None None] MFA Rules not processed for user `bc3e07a089f643c994dea7e0301b25bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:49.347309 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ab9b0f5f-98b7-4c20-8de9-cfeb532dd694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:49.425663 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1373/2738] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:49.437604 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:49.439955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:49.469355 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:49.520801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2805c-3bbf-4690-8647-666c832e78df admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.530154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f27bf4-ac57-44df-b42f-6e71b5328f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.530154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f27bf4-ac57-44df-b42f-6e71b5328f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.530154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f27bf4-ac57-44df-b42f-6e71b5328f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.530154 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f27bf4-ac57-44df-b42f-6e71b5328f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.543494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f27bf4-ac57-44df-b42f-6e71b5328f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.545378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f27bf4-ac57-44df-b42f-6e71b5328f17 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.557692 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1366/2739] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:50.999972 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:51.000583 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:51.000874 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:51.021426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] MFA Rules not processed for user `bc3e07a089f643c994dea7e0301b25bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:51.022751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:51.031595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1374/2740] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:55.383008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.383647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.383647 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.404916 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] MFA Rules not processed for user `3ab5993eff6d4817a804994a3787b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:55.406165 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:55.495623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1367/2741] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:50:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:55.897035 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.899090 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:55.912780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:55.966806 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594c270-f7c2-48c9-81fd-ee6adbbe8596 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.970912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.971772 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.972205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.972490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.974956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:56.003151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.004329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.015526 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1375/2742] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:04.801418 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.802862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:04.943160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f7faa-892d-46e4-b799-bcfed13c1b05 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.948641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.949530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.949819 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.950101 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] PATH_INFO: `/v3/users/fd334aedf10f4028ab81295f3d214ea9` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.951359 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd334aedf10f4028ab81295f3d214ea9)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.953378 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.962589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:05.014901 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd334aedf10f4028ab81295f3d214ea9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.016272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd334aedf10f4028ab81295f3d214ea9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.020161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd334aedf10f4028ab81295f3d214ea9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.033643 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd334aedf10f4028ab81295f3d214ea9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.045108 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd334aedf10f4028ab81295f3d214ea9'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.068696 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1368/2743] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:04 2022] DELETE /identity/v3/users/fd334aedf10f4028ab81295f3d214ea9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.388770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.406599 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d38b-a9ff-4d5f-b7bf-fe433d142e6e service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.481768 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.482757 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.483116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.483491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] PATH_INFO: `/v3/projects/26102fc21f4e44c1a34d1be98e673c63` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.485036 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26102fc21f4e44c1a34d1be98e673c63)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.487329 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.545884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26102fc21f4e44c1a34d1be98e673c63', 'request_id': 'req-717820ad-13dc-4e90-a2f3-b7c564ffd44c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.554945 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26102fc21f4e44c1a34d1be98e673c63', 'request_id': 'req-717820ad-13dc-4e90-a2f3-b7c564ffd44c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.561384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26102fc21f4e44c1a34d1be98e673c63', 'request_id': 'req-717820ad-13dc-4e90-a2f3-b7c564ffd44c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.573606 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] The token cache is being invalidate because project 26102fc21f4e44c1a34d1be98e673c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:05.573895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.574571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.576231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1376/2744] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:05 2022] DELETE /identity/v3/projects/26102fc21f4e44c1a34d1be98e673c63 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.580236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.581681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:05.595002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059753e0-82a2-47ef-b62d-3c02a693f32f admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.653181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.654091 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.654380 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.654661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] PATH_INFO: `/v3/users/ded273790e7e465d8e431b353c05edba` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.655906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded273790e7e465d8e431b353c05edba)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.657839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.714146 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded273790e7e465d8e431b353c05edba'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.714805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded273790e7e465d8e431b353c05edba'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.715435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded273790e7e465d8e431b353c05edba'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.730200 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded273790e7e465d8e431b353c05edba'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.738162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-6ddb3589-510d-4e43-9fd7-e17389f0a6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded273790e7e465d8e431b353c05edba'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:05.755078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1369/2745] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:05 2022] DELETE /identity/v3/users/ded273790e7e465d8e431b353c05edba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.950922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.953465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:05.980881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717820ad-13dc-4e90-a2f3-b7c564ffd44c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:06.044971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:06.067559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:06.068349 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:06.068632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:06.068909 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] PATH_INFO: `/v3/projects/15887f27b9534818b91683f45f6111b0` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:06.070144 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15887f27b9534818b91683f45f6111b0)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:06.072135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:06.122980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15887f27b9534818b91683f45f6111b0', 'request_id': 'req-d833f9d3-d28c-489b-a05f-8099a59b3e2c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:06.136592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15887f27b9534818b91683f45f6111b0', 'request_id': 'req-d833f9d3-d28c-489b-a05f-8099a59b3e2c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:06.143320 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15887f27b9534818b91683f45f6111b0', 'request_id': 'req-d833f9d3-d28c-489b-a05f-8099a59b3e2c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:06.156198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] The token cache is being invalidate because project 15887f27b9534818b91683f45f6111b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:06.156484 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:06.157143 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:06.158678 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1377/2746] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:05 2022] DELETE /identity/v3/projects/15887f27b9534818b91683f45f6111b0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:09.022137 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dd6d9-c793-4db1-b357-94759ebd00eb None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:09.023241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dd6d9-c793-4db1-b357-94759ebd00eb None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:09.023360 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dd6d9-c793-4db1-b357-94759ebd00eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:09.030058 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:09.057600 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-101dd6d9-c793-4db1-b357-94759ebd00eb None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:09.058841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-101dd6d9-c793-4db1-b357-94759ebd00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:09.156034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1370/2747] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:51:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:09.167823 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:09.169306 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:09.261495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f9d3-d28c-489b-a05f-8099a59b3e2c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:09.267644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:09.268314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:09.268605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:09.268887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:09.278461 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:09.280147 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:09.289262 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1378/2748] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:51:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:51:09.880513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc274cfa-1ec1-4eb5-b554-f8b696f9b853 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:09.880857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc274cfa-1ec1-4eb5-b554-f8b696f9b853 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:09.881145 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc274cfa-1ec1-4eb5-b554-f8b696f9b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:09.904399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-bc274cfa-1ec1-4eb5-b554-f8b696f9b853 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:09.905546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-bc274cfa-1ec1-4eb5-b554-f8b696f9b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:09.913637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1371/2749] 10.222.0.57 () {58 vars in 967 bytes} [Mon Jul 25 08:51:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:09.925747 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:09.937418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bdbfc-defe-42e9-8ed8-85bac6114e1b service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:09.942799 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:09.943517 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:09.943804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:09.944081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:09.953062 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:09.954671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:09.964464 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1379/2750] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:51:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:51:10.249249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba31a6-8407-4ec0-9bd6-ae45fa52ca15 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:10.249805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba31a6-8407-4ec0-9bd6-ae45fa52ca15 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:10.250687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba31a6-8407-4ec0-9bd6-ae45fa52ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:10.279967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-76ba31a6-8407-4ec0-9bd6-ae45fa52ca15 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:10.281293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-76ba31a6-8407-4ec0-9bd6-ae45fa52ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:10.296318 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1372/2751] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Jul 25 08:51:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:10.314118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:10.326216 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55ac5-9d9f-43cc-8f07-9f31ee0f4ebd service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:10.331522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:10.332181 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:10.332871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:10.332871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:10.342856 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:10.344528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:10.355258 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1380/2752] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:51:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:51:10.742979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:10.743263 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:10.743778 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:10.766474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] MFA Rules not processed for user `ffab8172e35f4150ac7303eeceb05738`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:10.767760 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:10.776166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1373/2753] 10.222.0.57 () {58 vars in 967 bytes} [Mon Jul 25 08:51:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:10.792899 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:10.805666 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dd837-924a-4295-9ce7-7eefea796d5f service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:10.813556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e150c6-30aa-49d0-a86e-e75962a42326 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da2eb51566940d7bee3a44f019e06ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:10.814225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e150c6-30aa-49d0-a86e-e75962a42326 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:10.814530 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e150c6-30aa-49d0-a86e-e75962a42326 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:10.814784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e150c6-30aa-49d0-a86e-e75962a42326 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:10.826865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e150c6-30aa-49d0-a86e-e75962a42326 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:10.828538 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e150c6-30aa-49d0-a86e-e75962a42326 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:10.838867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1381/2754] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Jul 25 08:51:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:51:13.090119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:13.091665 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.165365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a3f7-3f58-4f5d-9921-99e60a5c2bd9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:13.170009 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:13.170917 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.171206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.171519 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] PATH_INFO: `/v3/users/bc3e07a089f643c994dea7e0301b25bb` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.172762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3e07a089f643c994dea7e0301b25bb)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:13.174691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:13.222172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3e07a089f643c994dea7e0301b25bb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.222825 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3e07a089f643c994dea7e0301b25bb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.223487 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3e07a089f643c994dea7e0301b25bb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.234870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:13.237358 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3e07a089f643c994dea7e0301b25bb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.246275 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3e07a089f643c994dea7e0301b25bb'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.260694 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1374/2755] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:13 2022] DELETE /identity/v3/users/bc3e07a089f643c994dea7e0301b25bb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:13.265396 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.265867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.265986 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.295646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:13.296876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.305912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:13.359826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1382/2756] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:13.370201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:13.371691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.433628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974281-8772-46be-bae5-24a9b74a432a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:13.437327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0505-002e-47fa-8edd-faa7997512c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:13.437987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0505-002e-47fa-8edd-faa7997512c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.438276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0505-002e-47fa-8edd-faa7997512c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.438557 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0505-002e-47fa-8edd-faa7997512c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.448210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f0505-002e-47fa-8edd-faa7997512c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:13.449650 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f0505-002e-47fa-8edd-faa7997512c4 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:13.459330 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1375/2757] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:13.642073 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:13.643921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.660990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee387c1-ce37-4de1-a295-a1f968ece6cf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:13.667475 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:13.669565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.670231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.670629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] PATH_INFO: `/v3/projects/414788d2798641739975c1e657e240f5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.672377 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414788d2798641739975c1e657e240f5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:13.675238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:13.727173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414788d2798641739975c1e657e240f5', 'request_id': 'req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.734976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414788d2798641739975c1e657e240f5', 'request_id': 'req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.740759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414788d2798641739975c1e657e240f5', 'request_id': 'req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.752331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] The token cache is being invalidate because project 414788d2798641739975c1e657e240f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:13.752616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.753266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-027bdb5e-8c96-4de7-9521-cf3ad2e182c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.754804 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1383/2758] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:13 2022] DELETE /identity/v3/projects/414788d2798641739975c1e657e240f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:13.759950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.760245 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.760529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.814344 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:13.815606 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.877805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1376/2759] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:13.886622 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.886897 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.887179 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.907333 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:13.908559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.918296 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1384/2760] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:13.922830 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:13.932823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc90219-6dd8-4b2d-8533-80034526f24a None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:13.937479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:13.938150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.938438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.938718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.939481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:13.939794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:13.941756 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:13.954491 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1377/2761] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:13.958956 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:13.969175 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09792eb-178d-4643-9bf9-e0aa4433bb53 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:13.973820 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:13.974568 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.974857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.975138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.975884 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:13.978063 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.007444 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1385/2762] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:13 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:14.010698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.020755 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282dec-63ea-4374-9cc4-8e4f265839d2 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.064775 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:14.089399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.090075 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.090361 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.090931 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.091331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.093279 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.115240 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1378/2763] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:14.119522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.129950 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beda07b-3bc3-4126-889f-019626542058 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.134998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.135694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.135980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.136251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.136984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.138576 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.149829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1386/2764] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:14.153936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.164421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df533e-0a60-41de-b4ef-04a9ede8887b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.169222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48206-db58-43ab-89b6-4e61d06dc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.169905 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48206-db58-43ab-89b6-4e61d06dc932 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.170211 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48206-db58-43ab-89b6-4e61d06dc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.170472 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48206-db58-43ab-89b6-4e61d06dc932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.171210 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d48206-db58-43ab-89b6-4e61d06dc932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.172856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d48206-db58-43ab-89b6-4e61d06dc932 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.184270 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1379/2765] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:14.188384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.199261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c99f7b-864f-426a-9dd0-e1dfc9e2389f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.203911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.204790 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.205076 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.205379 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] PATH_INFO: `/v3/projects/095a4a5d059b423eb809cf657237b8d1/users/d1124e5bf95e4ab2b07701cf4db25b8a/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.221272 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095a4a5d059b423eb809cf657237b8d1, user_id=d1124e5bf95e4ab2b07701cf4db25b8a, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.223971 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.238807 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1387/2766] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:14 2022] PUT /identity/v3/projects/095a4a5d059b423eb809cf657237b8d1/users/d1124e5bf95e4ab2b07701cf4db25b8a/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:14.249444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.249738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.250045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.279803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] MFA Rules not processed for user `d1124e5bf95e4ab2b07701cf4db25b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:14.281042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:14.347011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1380/2767] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:14.358791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.360626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:14.398384 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:14.424302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aa72e-8a1d-4b62-b7b6-b28c4c2d09a0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.427992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.429180 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.429466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.429744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.438751 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.440236 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.451117 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1388/2768] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:18.204239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:18.205738 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:18.299946 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97256e82-1355-42e7-b482-1b14a90372a9 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:18.305661 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:18.306328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:18.306869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:18.306869 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:18.308735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:18.321701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:18.323357 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a61a5-efba-47c0-98ef-249b3cbc4b26 service placement] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:18.334566 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1381/2769] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:19.482178 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:19.550101 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32739c0f-3206-450b-b662-055765cf5acb service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:19.555837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:19.556714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:19.556992 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:19.557265 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] PATH_INFO: `/v3/users/d1124e5bf95e4ab2b07701cf4db25b8a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:19.558528 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1124e5bf95e4ab2b07701cf4db25b8a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:19.560724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:19.610390 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1124e5bf95e4ab2b07701cf4db25b8a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:19.611052 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1124e5bf95e4ab2b07701cf4db25b8a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:19.611681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1124e5bf95e4ab2b07701cf4db25b8a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:19.624372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1124e5bf95e4ab2b07701cf4db25b8a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:19.632489 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1124e5bf95e4ab2b07701cf4db25b8a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:19.645621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1389/2770] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:19 2022] DELETE /identity/v3/users/d1124e5bf95e4ab2b07701cf4db25b8a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:19.650204 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:19.650741 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:19.650844 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:19.670037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:19.671258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:19.689001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:19.737024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1382/2771] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:19.748867 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:19.750385 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:19.809189 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26c264-d18b-4766-95f8-4ceac0515e4f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:19.812826 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:19.813483 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:19.813763 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:19.814039 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:19.824058 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:19.825498 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:19.829503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:19.836949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1390/2772] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:20.106499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.108232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:20.121342 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdd6d2-93b7-47c6-b2d0-5d5c143d47d8 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.126032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.126932 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.127220 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.127529 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] PATH_INFO: `/v3/projects/095a4a5d059b423eb809cf657237b8d1` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.128719 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095a4a5d059b423eb809cf657237b8d1)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.130672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.179093 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095a4a5d059b423eb809cf657237b8d1', 'request_id': 'req-44be6122-8383-453a-8ce8-890019743b85'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.186528 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095a4a5d059b423eb809cf657237b8d1', 'request_id': 'req-44be6122-8383-453a-8ce8-890019743b85'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.192258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095a4a5d059b423eb809cf657237b8d1', 'request_id': 'req-44be6122-8383-453a-8ce8-890019743b85'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.203118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] The token cache is being invalidate because project 095a4a5d059b423eb809cf657237b8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:20.203438 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.204076 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.205886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1383/2773] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:20 2022] DELETE /identity/v3/projects/095a4a5d059b423eb809cf657237b8d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:29.840978 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:30.200186 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:07.879060 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:07.880615 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:07.895163 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea18c0-f949-4855-9712-10e8b82e4daa service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:07.966362 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:07.967251 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:07.967592 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:07.967871 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] PATH_INFO: `/v3/users/3ab5993eff6d4817a804994a3787b3ca` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:07.971299 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab5993eff6d4817a804994a3787b3ca)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:07.973376 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.031888 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab5993eff6d4817a804994a3787b3ca'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.032635 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab5993eff6d4817a804994a3787b3ca'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.033452 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab5993eff6d4817a804994a3787b3ca'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.051359 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab5993eff6d4817a804994a3787b3ca'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.061646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc3204ac-9b55-4401-b4ff-69b53c63e4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab5993eff6d4817a804994a3787b3ca'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.075231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1391/2774] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:07 2022] DELETE /identity/v3/users/3ab5993eff6d4817a804994a3787b3ca => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:08.268310 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.270241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:08.286943 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6122-8383-453a-8ce8-890019743b85 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.374618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.375590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.375840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.376121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] PATH_INFO: `/v3/projects/bcb55710690d4fa9b1991c3116c27cf4` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.377476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb55710690d4fa9b1991c3116c27cf4)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.379332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.444332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb55710690d4fa9b1991c3116c27cf4', 'request_id': 'req-81623060-55b1-4864-8991-be28ed9ffd85'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.455274 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb55710690d4fa9b1991c3116c27cf4', 'request_id': 'req-81623060-55b1-4864-8991-be28ed9ffd85'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.463924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb55710690d4fa9b1991c3116c27cf4', 'request_id': 'req-81623060-55b1-4864-8991-be28ed9ffd85'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.480853 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] The token cache is being invalidate because project bcb55710690d4fa9b1991c3116c27cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:08.481197 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.481934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-81623060-55b1-4864-8991-be28ed9ffd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:08.483658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1384/2775] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:08 2022] DELETE /identity/v3/projects/bcb55710690d4fa9b1991c3116c27cf4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:08.489406 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.489811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.490099 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.512512 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:08.514456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:08.591125 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1392/2776] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:08.599500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.599797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.600085 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.626193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:08.627474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:08.637287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1385/2777] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:08.641969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.662690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0fba9-9a69-448a-a532-c77ab5345501 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.671405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.672363 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.672573 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.673313 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.674566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:08.674566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.675644 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.690508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1393/2778] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:08.695955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.706004 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651208d9-36ed-4942-8dcb-aa47281ea4c2 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.711710 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.712446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.712723 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.713002 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.713718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.715668 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.746595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1386/2779] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:08 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:08.750650 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.762124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7166f60-70d6-4303-938f-356cb6415469 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.766439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:08.840889 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.841567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.841855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.842138 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.842841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.844818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.866653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1394/2780] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:08 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:08.871043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.881596 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0771-19d3-43c0-befb-c90cdfce3382 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.886977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.887753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.887973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.888222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.888947 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.890547 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.902213 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1387/2781] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:08.906304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.916516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ff1d-dc5b-4efe-9bb5-1ef33c74545c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.921235 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf1c6-63bd-4b43-9c12-d3cdb226ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.921892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf1c6-63bd-4b43-9c12-d3cdb226ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.922177 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf1c6-63bd-4b43-9c12-d3cdb226ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.922456 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf1c6-63bd-4b43-9c12-d3cdb226ab20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.923214 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bf1c6-63bd-4b43-9c12-d3cdb226ab20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.924903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bf1c6-63bd-4b43-9c12-d3cdb226ab20 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.935196 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1395/2782] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:08.940020 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:08.950700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7639-2997-407b-a050-fec1c66f3e93 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:08.955603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:08.956479 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:08.956768 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:08.957041 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] PATH_INFO: `/v3/projects/5239344a30164982b19e8f48f5615b3f/users/2086830af43e4ab987c485cc780b13b1/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:08.972407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5239344a30164982b19e8f48f5615b3f, user_id=2086830af43e4ab987c485cc780b13b1, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:08.975153 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:08.989184 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1388/2783] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:08 2022] PUT /identity/v3/projects/5239344a30164982b19e8f48f5615b3f/users/2086830af43e4ab987c485cc780b13b1/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:09.001415 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.001687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.001963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.030979 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] MFA Rules not processed for user `2086830af43e4ab987c485cc780b13b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:09.032223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:09.097929 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1396/2784] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:09.102622 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.133394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:09.168598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a198be7-17e5-4c7e-9fb8-176b111bec80 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.173379 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.174050 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.174339 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.174621 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.175322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.177268 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.206307 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1389/2785] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:09 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:09.209824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.221054 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca555-0a2d-40e4-b3a5-cce737680bb4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.282858 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.283577 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.283863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.284142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.284855 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.286821 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.312980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1397/2786] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:09 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:09.317025 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.329410 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f9c01-3355-42c3-87d5-1091be9e7d66 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.335029 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.335950 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.336350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.336513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.337244 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.339090 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.352467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1390/2787] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:09.357579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.364193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:09.368697 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef4ff-10f8-448f-946a-8e13bed06ef7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.374520 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.375440 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.375723 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.376011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] PATH_INFO: `/v3/projects/6e36915cd2be401e9df2adba0eefedba/users/b9d7c827ede34f35a8ddc6d5d143926f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.391939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e36915cd2be401e9df2adba0eefedba, user_id=b9d7c827ede34f35a8ddc6d5d143926f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.394805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.408476 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1398/2788] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:09 2022] PUT /identity/v3/projects/6e36915cd2be401e9df2adba0eefedba/users/b9d7c827ede34f35a8ddc6d5d143926f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:09.413970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.424462 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4e4f-70ab-4f5b-8a93-55ef381e8b52 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.487326 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87c41-1c9d-43a1-8841-732784165afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.488035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87c41-1c9d-43a1-8841-732784165afd admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.488323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87c41-1c9d-43a1-8841-732784165afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.488605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87c41-1c9d-43a1-8841-732784165afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.489341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87c41-1c9d-43a1-8841-732784165afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.490966 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87c41-1c9d-43a1-8841-732784165afd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.502623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1391/2789] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:09.506982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.517832 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d4502-f057-4e67-ae2d-5aa5e26d22df admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.522788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.523724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.524011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.524292 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] PATH_INFO: `/v3/projects/6e36915cd2be401e9df2adba0eefedba/users/b9d7c827ede34f35a8ddc6d5d143926f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.526343 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e36915cd2be401e9df2adba0eefedba, user_id=b9d7c827ede34f35a8ddc6d5d143926f, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.529074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.540802 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1399/2790] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:09 2022] PUT /identity/v3/projects/6e36915cd2be401e9df2adba0eefedba/users/b9d7c827ede34f35a8ddc6d5d143926f/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:09.551409 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.551727 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.552011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.580478 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] MFA Rules not processed for user `b9d7c827ede34f35a8ddc6d5d143926f`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:09.581724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:09.655129 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1392/2791] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:09.667539 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.669412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:09.759300 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7516f-1923-4c27-847c-51f8a34a8ff6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.763934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.763934 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.764248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.764439 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.775290 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.776784 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.787081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1400/2792] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:09.870977 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:09.880814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937caf2-1efe-4a70-aae8-81d979f33497 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:09.884646 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93d43-1a7b-435c-b0ef-7edce3e79727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:09.885293 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93d43-1a7b-435c-b0ef-7edce3e79727 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:09.885580 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93d43-1a7b-435c-b0ef-7edce3e79727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:09.885862 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93d43-1a7b-435c-b0ef-7edce3e79727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:09.909212 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:09.953716 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93d43-1a7b-435c-b0ef-7edce3e79727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:09.955168 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93d43-1a7b-435c-b0ef-7edce3e79727 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:09.964967 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1393/2793] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:16.957846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:17.022018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee490572-4993-4546-8d80-4df73063e1eb service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:17.027199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:17.028157 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:17.028412 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:17.028818 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] PATH_INFO: `/v3/users/2086830af43e4ab987c485cc780b13b1` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:17.029885 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2086830af43e4ab987c485cc780b13b1)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:17.031862 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:17.077844 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2086830af43e4ab987c485cc780b13b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.078504 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2086830af43e4ab987c485cc780b13b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.079305 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2086830af43e4ab987c485cc780b13b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.084786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:17.094199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2086830af43e4ab987c485cc780b13b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.102065 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2086830af43e4ab987c485cc780b13b1'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.114778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1401/2794] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:16 2022] DELETE /identity/v3/users/2086830af43e4ab987c485cc780b13b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:17.119419 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:17.119887 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:17.119985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:17.142551 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:17.143884 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:17.204788 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1394/2795] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:17.215360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:17.216837 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:17.296711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0dcd-e2f2-4f7f-8902-139d6a16cfce admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:17.300331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:17.300981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:17.301271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:17.301550 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:17.311559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:17.313001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:17.323182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1402/2796] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:17.616866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:17.618798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:17.633874 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76071-3729-4ad4-a7be-ad553ac7d061 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:17.640492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:17.641725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:17.642011 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:17.642322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] PATH_INFO: `/v3/projects/5239344a30164982b19e8f48f5615b3f` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:17.643800 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5239344a30164982b19e8f48f5615b3f)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:17.645717 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:17.696115 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5239344a30164982b19e8f48f5615b3f', 'request_id': 'req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.704748 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5239344a30164982b19e8f48f5615b3f', 'request_id': 'req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.713669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5239344a30164982b19e8f48f5615b3f', 'request_id': 'req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.730956 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] The token cache is being invalidate because project 5239344a30164982b19e8f48f5615b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:17.731509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.732188 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.733999 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1395/2797] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:17 2022] DELETE /identity/v3/projects/5239344a30164982b19e8f48f5615b3f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:17.738819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:17.749778 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3f35-b34c-4506-a4f1-03f09d020b20 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:17.813420 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:17.814223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:17.814511 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:17.814788 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] PATH_INFO: `/v3/users/b9d7c827ede34f35a8ddc6d5d143926f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:17.816020 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d7c827ede34f35a8ddc6d5d143926f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:17.817939 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:17.865933 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d7c827ede34f35a8ddc6d5d143926f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.866588 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d7c827ede34f35a8ddc6d5d143926f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.867199 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d7c827ede34f35a8ddc6d5d143926f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.872859 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:17.881029 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d7c827ede34f35a8ddc6d5d143926f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.889037 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d742b189-82ce-48fa-87ae-75761bb619fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d7c827ede34f35a8ddc6d5d143926f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:17.906865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1403/2798] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:17 2022] DELETE /identity/v3/users/b9d7c827ede34f35a8ddc6d5d143926f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:18.188712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.191045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:18.204356 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc844-ed55-4d7e-a21d-f6da2b94bc44 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.250500 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:18.267124 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.268039 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.268328 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.268603 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] PATH_INFO: `/v3/projects/6e36915cd2be401e9df2adba0eefedba` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.269798 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e36915cd2be401e9df2adba0eefedba)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.271814 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.322077 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e36915cd2be401e9df2adba0eefedba', 'request_id': 'req-d5d04e19-6a22-4c60-8975-30d8a9378216'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:18.329952 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e36915cd2be401e9df2adba0eefedba', 'request_id': 'req-d5d04e19-6a22-4c60-8975-30d8a9378216'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:18.335762 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e36915cd2be401e9df2adba0eefedba', 'request_id': 'req-d5d04e19-6a22-4c60-8975-30d8a9378216'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:18.348525 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] The token cache is being invalidate because project 6e36915cd2be401e9df2adba0eefedba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:18.348813 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:18.349460 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-d5d04e19-6a22-4c60-8975-30d8a9378216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:18.350988 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1396/2799] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:18 2022] DELETE /identity/v3/projects/6e36915cd2be401e9df2adba0eefedba => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:18.356603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.357093 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.357193 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.377981 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:18.379207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:18.441904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1404/2800] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:18.450083 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.450371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.450654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.470640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:18.471876 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:18.479984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1397/2801] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:18.484142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.494803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c836c7-2bfc-4d51-b8ce-14570dd9da09 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.499742 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.500409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.500696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.500974 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.501706 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:18.502014 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.503639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.516411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1405/2802] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:18.520875 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.531152 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d77d87-864c-4584-b936-c3e38fc7fc3f None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.535929 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.536588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.536870 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.537143 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.537839 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.539761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.568590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1398/2803] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:18 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:18.573714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.583718 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d257490-3566-46ef-9f37-0285ee37f803 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.642149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.642829 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.643116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.643423 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.644123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.646081 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.669654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1406/2804] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:18 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:18.675297 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.689735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073bf1-9aea-42a1-a84f-e8dbd03e9779 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.695751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.696421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.696708 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.696985 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.698230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.700047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.712161 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1399/2805] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:18.717355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.732008 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8d49-110f-43f8-8806-055e23317942 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.736750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c032c04-620a-46af-8f73-a3edecc41423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.737418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c032c04-620a-46af-8f73-a3edecc41423 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.737701 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c032c04-620a-46af-8f73-a3edecc41423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.737980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c032c04-620a-46af-8f73-a3edecc41423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.738812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c032c04-620a-46af-8f73-a3edecc41423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.740446 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c032c04-620a-46af-8f73-a3edecc41423 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.752207 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1407/2806] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:18.756505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:18.767530 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c6aa-4bec-4e75-a08f-a7e1127b6786 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:18.772160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:18.773064 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.773350 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.773642 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] PATH_INFO: `/v3/projects/8459371bf88740088f7ea8c5e14ca016/users/5a49e81c8ee3484d84ff869a966b1b42/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.788456 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8459371bf88740088f7ea8c5e14ca016, user_id=5a49e81c8ee3484d84ff869a966b1b42, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:18.791535 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:18.805407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1400/2807] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:18 2022] PUT /identity/v3/projects/8459371bf88740088f7ea8c5e14ca016/users/5a49e81c8ee3484d84ff869a966b1b42/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:18.817205 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:18.817487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:18.817759 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:18.846225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] MFA Rules not processed for user `5a49e81c8ee3484d84ff869a966b1b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:18.847403 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:18.874736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:18.929115 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1408/2808] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:18.934142 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.007704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650343b-24bb-44ab-8c81-6e76ecb6786b admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.019638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.020429 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.020724 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.023281 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.024579 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.026993 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.050251 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:19.070049 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1401/2809] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:18 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:19.074811 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.085958 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22623f-6c6a-4eca-bd5a-5addcac0f59c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.143750 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.144347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.144634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.144908 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.145602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.147561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.176639 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1409/2810] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:19 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:19.178316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.194639 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f36b48-82d7-465e-ab3e-cc0bdbe78677 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.201474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.202335 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.202852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.203127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.204363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.206774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.225421 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1402/2811] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:19.230668 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.243295 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492db081-2a4f-4e71-9c5f-998e9d2bd40b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.248691 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.249596 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.249887 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.250166 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] PATH_INFO: `/v3/projects/326be705956a4653acf7d3a11a69e808/users/af5e16523da842d9903c1d3032c800a2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.274976 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=326be705956a4653acf7d3a11a69e808, user_id=af5e16523da842d9903c1d3032c800a2, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.278482 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.295427 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1410/2812] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:19 2022] PUT /identity/v3/projects/326be705956a4653acf7d3a11a69e808/users/af5e16523da842d9903c1d3032c800a2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:19.300054 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.315629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd2bf3-c473-480d-b21e-b6feb0f7ce29 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.376687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d16f7-7a0c-4c76-9d10-996ea1a2758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.377367 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d16f7-7a0c-4c76-9d10-996ea1a2758e admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.377631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d16f7-7a0c-4c76-9d10-996ea1a2758e admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.378119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d16f7-7a0c-4c76-9d10-996ea1a2758e admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.378948 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d16f7-7a0c-4c76-9d10-996ea1a2758e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.380571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d16f7-7a0c-4c76-9d10-996ea1a2758e admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.390807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1403/2813] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:19.395354 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.405841 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025aa49-5dab-4b11-82fd-e083e6bcf00e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.410523 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.411431 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.411716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.411998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] PATH_INFO: `/v3/projects/326be705956a4653acf7d3a11a69e808/users/af5e16523da842d9903c1d3032c800a2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.413994 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] RBAC: Authorizing `identity:create_grant(project_id=326be705956a4653acf7d3a11a69e808, user_id=af5e16523da842d9903c1d3032c800a2, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.417228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.428529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1411/2814] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:19 2022] PUT /identity/v3/projects/326be705956a4653acf7d3a11a69e808/users/af5e16523da842d9903c1d3032c800a2/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:19.440047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.440346 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.440629 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.471747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] MFA Rules not processed for user `af5e16523da842d9903c1d3032c800a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:19.473239 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:19.547131 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1404/2815] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:19.559347 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:19.561414 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:19.625602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f582a0-5193-4549-892d-f85e1ddb871b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:19.629421 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d1e7b-21e0-4663-9ec8-46d6428a2dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:19.630075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d1e7b-21e0-4663-9ec8-46d6428a2dba service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:19.630358 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d1e7b-21e0-4663-9ec8-46d6428a2dba service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:19.630634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d1e7b-21e0-4663-9ec8-46d6428a2dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:19.640679 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d1e7b-21e0-4663-9ec8-46d6428a2dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:19.642186 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d1e7b-21e0-4663-9ec8-46d6428a2dba service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:19.654162 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1412/2816] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:20.324243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:20.398971 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951937f-baf9-450a-81c3-896fbb51d6a1 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:20.403867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:20.404759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:20.405059 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:20.405332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] PATH_INFO: `/v3/users/5a49e81c8ee3484d84ff869a966b1b42` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:20.406594 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a49e81c8ee3484d84ff869a966b1b42)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:20.408631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:20.414469 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=100 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:20.468973 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a49e81c8ee3484d84ff869a966b1b42'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.469628 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a49e81c8ee3484d84ff869a966b1b42'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.470237 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a49e81c8ee3484d84ff869a966b1b42'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.487960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a49e81c8ee3484d84ff869a966b1b42'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.496023 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a49e81c8ee3484d84ff869a966b1b42'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.512187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1405/2817] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:20 2022] DELETE /identity/v3/users/5a49e81c8ee3484d84ff869a966b1b42 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:20.517902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:20.518631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:20.518631 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:20.544714 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:20.546341 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:20.567405 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:20.613395 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1413/2818] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:20.624222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:20.625648 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:20.686321 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd623-eb40-4d60-8cbd-25d8b3ab2194 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:20.690012 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:20.690657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:20.690940 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:20.691241 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:20.701336 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:20.702766 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:20.714399 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1406/2819] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:52:21.007626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:21.009118 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:21.025071 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31322385-f40d-44c6-a776-8f6ccce6a8b9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.034084 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.035621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.036332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.036864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] PATH_INFO: `/v3/projects/8459371bf88740088f7ea8c5e14ca016` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.038921 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8459371bf88740088f7ea8c5e14ca016)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.043322 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:21.102847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8459371bf88740088f7ea8c5e14ca016', 'request_id': 'req-38883137-5254-4b8c-bacb-c39eecda52d5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.111906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8459371bf88740088f7ea8c5e14ca016', 'request_id': 'req-38883137-5254-4b8c-bacb-c39eecda52d5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.119999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8459371bf88740088f7ea8c5e14ca016', 'request_id': 'req-38883137-5254-4b8c-bacb-c39eecda52d5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.132616 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] The token cache is being invalidate because project 8459371bf88740088f7ea8c5e14ca016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:21.132902 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.134561 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.138465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1414/2820] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:21 2022] DELETE /identity/v3/projects/8459371bf88740088f7ea8c5e14ca016 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:21.143517 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:21.154471 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80787-e8dc-4f1a-8aa8-401d7850166e service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.220047 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.220924 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.221209 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.221489 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] PATH_INFO: `/v3/users/af5e16523da842d9903c1d3032c800a2` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.222794 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5e16523da842d9903c1d3032c800a2)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.224752 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:21.266363 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:21.287444 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5e16523da842d9903c1d3032c800a2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.288160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5e16523da842d9903c1d3032c800a2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.288804 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5e16523da842d9903c1d3032c800a2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.302447 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5e16523da842d9903c1d3032c800a2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.309284 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-c4f5f156-8c56-4c45-a90e-cdbc9705a435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5e16523da842d9903c1d3032c800a2'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.323823 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1407/2821] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:21 2022] DELETE /identity/v3/users/af5e16523da842d9903c1d3032c800a2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:21.661491 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:21.663088 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:21.682914 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883137-5254-4b8c-bacb-c39eecda52d5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.742621 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.743519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.743865 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.744629 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] PATH_INFO: `/v3/projects/326be705956a4653acf7d3a11a69e808` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.745812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326be705956a4653acf7d3a11a69e808)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.747797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:21.795846 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:21.797605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326be705956a4653acf7d3a11a69e808', 'request_id': 'req-f390781c-4038-4546-9be9-3093bd745d05'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.807497 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326be705956a4653acf7d3a11a69e808', 'request_id': 'req-f390781c-4038-4546-9be9-3093bd745d05'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.814151 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326be705956a4653acf7d3a11a69e808', 'request_id': 'req-f390781c-4038-4546-9be9-3093bd745d05'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.826944 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] The token cache is being invalidate because project 326be705956a4653acf7d3a11a69e808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:21.827471 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.828548 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f390781c-4038-4546-9be9-3093bd745d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.830161 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1415/2822] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:21 2022] DELETE /identity/v3/projects/326be705956a4653acf7d3a11a69e808 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:21.836285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.836846 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.836970 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.862185 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:21.864006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:21.935779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1408/2823] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:21.944744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.945030 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.945315 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.965732 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:21.966949 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:21.974998 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1416/2824] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:21.979657 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:21.989382 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04745c-b678-49e4-9a27-b60ff8af754e None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.993980 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.995141 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.995510 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.995785 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.996562 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:21.996866 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.998459 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.011024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1409/2825] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:22.015758 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.026762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d0f44-0cb5-4d81-a33f-321f3a2a904e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.032372 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.033209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.033493 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.033765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.034812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.037155 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.069042 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1417/2826] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:22 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:22.074130 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.086764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3ed6-661f-4d9d-a78c-d427d5c80130 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.146654 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.147327 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.147670 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.147906 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.148595 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.150546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.174637 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1410/2827] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:22 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:22.237602 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.251554 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce5269-c5a4-4e30-8f26-79a5bf1e9fb3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.256736 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.257409 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.257695 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.257973 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.258765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.260438 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.271304 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1418/2828] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:22.276817 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.291728 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324fed0-832a-4662-b7a0-1363250af4bf admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.298061 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50889b7-0779-4edb-bd4b-73ec53141961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.298969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50889b7-0779-4edb-bd4b-73ec53141961 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.299276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50889b7-0779-4edb-bd4b-73ec53141961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.299761 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50889b7-0779-4edb-bd4b-73ec53141961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.300848 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50889b7-0779-4edb-bd4b-73ec53141961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.303285 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50889b7-0779-4edb-bd4b-73ec53141961 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.319303 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1411/2829] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:22.323335 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.333646 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02eb7d-7d36-4d37-8620-20ad99c5030f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.338770 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.339797 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.340225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.340744 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] PATH_INFO: `/v3/projects/1ef8beea1abf424b9f0d7938135c7a49/users/43cbaf0b1cc246f883f5b3beab6c7420/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.359529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef8beea1abf424b9f0d7938135c7a49, user_id=43cbaf0b1cc246f883f5b3beab6c7420, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.362198 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.379705 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1419/2830] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:22 2022] PUT /identity/v3/projects/1ef8beea1abf424b9f0d7938135c7a49/users/43cbaf0b1cc246f883f5b3beab6c7420/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:22.392588 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.392907 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.393187 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.419536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:22.423126 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] MFA Rules not processed for user `43cbaf0b1cc246f883f5b3beab6c7420`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:22.424994 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:22.508045 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1412/2831] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:22.512582 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.576011 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb38ff-a858-42ac-8d13-3ee9a7176abe admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.580895 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.581574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.581850 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.582123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.582816 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.584756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.617756 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1420/2832] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:22 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:22.622765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.639544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186003ab-8115-49f4-9e16-15fd0d33e022 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.718718 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.719555 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.719722 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.720000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.720700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.722669 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.749172 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1413/2833] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:22 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:22.753259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.764053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862ed8-20af-4011-95dd-f09522d44135 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.768982 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.769654 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.769936 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.770225 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.770969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.772676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.784200 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1421/2834] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:22.788571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.800189 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2d29-45a4-4421-9a2b-ea9d56ff7594 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.805623 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.806536 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.806826 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.807107 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] PATH_INFO: `/v3/projects/15cef99ea5b1490b9f23f0fa96ca29a1/users/6fe69161f42d441b97657896ec380fdf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.823316 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cef99ea5b1490b9f23f0fa96ca29a1, user_id=6fe69161f42d441b97657896ec380fdf, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.826013 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.840229 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1414/2835] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:22 2022] PUT /identity/v3/projects/15cef99ea5b1490b9f23f0fa96ca29a1/users/6fe69161f42d441b97657896ec380fdf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:22.844228 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.854634 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b1c3-8ebd-405f-ab33-21f64a026788 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.898930 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:22.915630 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b21cbd-8dd4-4686-99c0-2087a52eb503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.916337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b21cbd-8dd4-4686-99c0-2087a52eb503 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.916662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b21cbd-8dd4-4686-99c0-2087a52eb503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.916937 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b21cbd-8dd4-4686-99c0-2087a52eb503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.917682 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b21cbd-8dd4-4686-99c0-2087a52eb503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.919432 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b21cbd-8dd4-4686-99c0-2087a52eb503 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.929952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1422/2836] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:52:22.934365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.944938 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0da19-6881-41c1-b1b5-e6a571f80400 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.950474 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.951375 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.951690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.951972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] PATH_INFO: `/v3/projects/15cef99ea5b1490b9f23f0fa96ca29a1/users/6fe69161f42d441b97657896ec380fdf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.953979 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cef99ea5b1490b9f23f0fa96ca29a1, user_id=6fe69161f42d441b97657896ec380fdf, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.956675 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.968206 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1415/2837] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:22 2022] PUT /identity/v3/projects/15cef99ea5b1490b9f23f0fa96ca29a1/users/6fe69161f42d441b97657896ec380fdf/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:22.978854 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.979152 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.979466 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.007676 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] MFA Rules not processed for user `6fe69161f42d441b97657896ec380fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:23.008907 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:23.085092 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1423/2838] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:23.097614 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.100308 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:23.166391 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb6b66-0b9e-4d1a-9e49-2bd61c05a829 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.170176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42950086-855b-4184-84df-51ead1856723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.170852 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42950086-855b-4184-84df-51ead1856723 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.171134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42950086-855b-4184-84df-51ead1856723 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.171467 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42950086-855b-4184-84df-51ead1856723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.183613 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42950086-855b-4184-84df-51ead1856723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.185088 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42950086-855b-4184-84df-51ead1856723 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.190014 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:23.197463 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1416/2839] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:23.280903 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.295661 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1c0ee-a904-4e16-bb7f-9cd10ceb4836 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.301075 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e0545-65a2-46a9-bc82-659bf56aae7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.301786 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0545-65a2-46a9-bc82-659bf56aae7c service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.302069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0545-65a2-46a9-bc82-659bf56aae7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.302348 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0545-65a2-46a9-bc82-659bf56aae7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.362990 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e0545-65a2-46a9-bc82-659bf56aae7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.364387 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e0545-65a2-46a9-bc82-659bf56aae7c service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.374425 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1424/2840] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:26.200538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42950086-855b-4184-84df-51ead1856723 service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.272955 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42950086-855b-4184-84df-51ead1856723 service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.280311 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.281545 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.281841 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.282162 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] PATH_INFO: `/v3/users/43cbaf0b1cc246f883f5b3beab6c7420` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.284136 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43cbaf0b1cc246f883f5b3beab6c7420)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.287578 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.354712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43cbaf0b1cc246f883f5b3beab6c7420'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.355365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43cbaf0b1cc246f883f5b3beab6c7420'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.356287 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43cbaf0b1cc246f883f5b3beab6c7420'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.372150 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43cbaf0b1cc246f883f5b3beab6c7420'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.382272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43cbaf0b1cc246f883f5b3beab6c7420'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.398736 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1417/2841] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:26 2022] DELETE /identity/v3/users/43cbaf0b1cc246f883f5b3beab6c7420 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:26.405813 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.406495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.406740 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.431796 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:26.433040 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:26.506284 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1425/2842] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:26.517782 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.519226 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:26.592276 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa259b99-8f1b-4dc1-8c0a-88420e89b150 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.595987 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.596636 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.596920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.597218 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.607700 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.609155 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.619139 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1418/2843] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:26.897584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.899441 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:26.912771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62afe9-00ef-4cf0-8a7a-744de1730f6e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.917648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.918669 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.918955 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.919365 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] PATH_INFO: `/v3/projects/1ef8beea1abf424b9f0d7938135c7a49` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.920681 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef8beea1abf424b9f0d7938135c7a49)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.922605 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.924404 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:26.971298 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef8beea1abf424b9f0d7938135c7a49', 'request_id': 'req-9e29f214-93f5-4f89-8b1b-54d9dd41118e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.978645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef8beea1abf424b9f0d7938135c7a49', 'request_id': 'req-9e29f214-93f5-4f89-8b1b-54d9dd41118e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.984911 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef8beea1abf424b9f0d7938135c7a49', 'request_id': 'req-9e29f214-93f5-4f89-8b1b-54d9dd41118e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.997355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] The token cache is being invalidate because project 1ef8beea1abf424b9f0d7938135c7a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:26.997645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.998308 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.999906 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1426/2844] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:26 2022] DELETE /identity/v3/projects/1ef8beea1abf424b9f0d7938135c7a49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:27.004044 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.015651 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aaa3e-90b1-4988-83f8-9c38aae97989 service neutron] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.032662 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:27.076477 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.077354 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.077641 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.077922 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] PATH_INFO: `/v3/users/6fe69161f42d441b97657896ec380fdf` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.079140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe69161f42d441b97657896ec380fdf)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.081092 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.129882 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe69161f42d441b97657896ec380fdf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.130494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe69161f42d441b97657896ec380fdf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.131116 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe69161f42d441b97657896ec380fdf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.144027 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe69161f42d441b97657896ec380fdf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.151635 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-3b007a9e-633b-4e9a-8ab6-05442f5664a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe69161f42d441b97657896ec380fdf'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.165032 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1419/2845] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:27 2022] DELETE /identity/v3/users/6fe69161f42d441b97657896ec380fdf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:27.480457 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.481988 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:27.504119 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29f214-93f5-4f89-8b1b-54d9dd41118e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.578227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.579129 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.579514 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.579801 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] PATH_INFO: `/v3/projects/15cef99ea5b1490b9f23f0fa96ca29a1` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.581046 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cef99ea5b1490b9f23f0fa96ca29a1)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.582999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.636935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cef99ea5b1490b9f23f0fa96ca29a1', 'request_id': 'req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.644948 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cef99ea5b1490b9f23f0fa96ca29a1', 'request_id': 'req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.651531 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cef99ea5b1490b9f23f0fa96ca29a1', 'request_id': 'req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.664443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] The token cache is being invalidate because project 15cef99ea5b1490b9f23f0fa96ca29a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:27.664767 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.665585 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5bfe0d3-c9d0-4db1-81ac-c8786f392bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:27.667952 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1427/2846] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:27 2022] DELETE /identity/v3/projects/15cef99ea5b1490b9f23f0fa96ca29a1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:27.673299 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.673842 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.673965 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.699000 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:27.700526 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:27.762797 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1420/2847] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:27.772001 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.772291 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.772566 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.793429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:27.794642 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:27.802840 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1428/2848] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:27.807365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.817838 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1473657-b4c3-4bd7-b0f3-2d8f8ca053d5 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.822464 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.823170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.823481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.823759 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.824486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80321) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:27.824793 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.826449 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.840341 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1421/2849] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:27.846213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.860506 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe390e-4921-4d5a-a8d5-3b9ee87f69a9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.869044 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.869731 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.870018 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.870297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.871003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.872983 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.885135 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:27.908791 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1429/2850] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:27 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:27.912653 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.925015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0031e-1f90-4eb3-8167-95e6ee674624 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.953584 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:27.988073 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.988751 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.989040 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.989323 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.990035 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.992006 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.013888 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1422/2851] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:27 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:28.017980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.028894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443fe6f-a82f-4c0a-ac86-3059ddfac850 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.033717 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.034374 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.034653 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.034926 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.035690 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.037360 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.048488 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1430/2852] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:28.052796 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.063234 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabeb52-5aba-42b8-89f9-daf6e87a48a6 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.068176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18af931-90d2-49a6-a65f-6517eddb5139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.068840 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af931-90d2-49a6-a65f-6517eddb5139 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.069127 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af931-90d2-49a6-a65f-6517eddb5139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.069411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af931-90d2-49a6-a65f-6517eddb5139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.070176 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18af931-90d2-49a6-a65f-6517eddb5139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.071822 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18af931-90d2-49a6-a65f-6517eddb5139 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.083122 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1423/2853] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:28.087479 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.098726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd949c-38b9-464b-a884-7ec0ee50544b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.103719 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.104607 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.104892 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.105169 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] PATH_INFO: `/v3/projects/3eb0c99c47a84ed78b68cf3966abe835/users/d71db8178f45410aa07366e8ea212241/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.119925 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0c99c47a84ed78b68cf3966abe835, user_id=d71db8178f45410aa07366e8ea212241, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.122574 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.136449 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1431/2854] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:28 2022] PUT /identity/v3/projects/3eb0c99c47a84ed78b68cf3966abe835/users/d71db8178f45410aa07366e8ea212241/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:28.147074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.147365 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.147691 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.176259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] MFA Rules not processed for user `d71db8178f45410aa07366e8ea212241`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:28.177406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:28.246094 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1424/2855] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:28.250637 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.314154 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc07cc-2460-46e0-9d59-56ff525c0aba admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.319285 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.320009 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.320337 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.320632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.321264 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.323752 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.354221 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1432/2856] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:28 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:28.358806 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.371397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696b53d-53bc-4231-8059-c752ada49f92 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.438160 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.438764 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.439048 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.439324 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] PATH_INFO: `/v3/users` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.440074 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.442042 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.466230 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1425/2857] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:28 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:28.470410 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.482567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21209-abd6-4fa2-b07f-c3e67b4fab8b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.487529 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.488227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.488507 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.488809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.489559 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.491182 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.503132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1433/2858] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:28.507765 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.518747 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29ba4-2c8e-4f19-a8e4-aa13b783cb43 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.523737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.524645 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.524934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.525249 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] PATH_INFO: `/v3/projects/818f60266ff34f4481c6d9dce86705ce/users/1b086b2e36fd481ca81662431b1ddf42/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.543620 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818f60266ff34f4481c6d9dce86705ce, user_id=1b086b2e36fd481ca81662431b1ddf42, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.546309 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.556105 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:28.562343 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1426/2859] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:28 2022] PUT /identity/v3/projects/818f60266ff34f4481c6d9dce86705ce/users/1b086b2e36fd481ca81662431b1ddf42/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:28.566302 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.577116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb866165-b2b7-4cbe-8ed1-849573ee3d9b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.634508 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2394db7-9c65-4088-9941-a0d7a7b120be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.635827 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2394db7-9c65-4088-9941-a0d7a7b120be admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.636116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2394db7-9c65-4088-9941-a0d7a7b120be admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.636394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2394db7-9c65-4088-9941-a0d7a7b120be admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.637123 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2394db7-9c65-4088-9941-a0d7a7b120be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.638729 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2394db7-9c65-4088-9941-a0d7a7b120be admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.648819 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1434/2860] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:28.652992 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.663486 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea29fbb-1ae1-4fdd-9bde-47ff7bd35906 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.668371 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.669258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.669544 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.669821 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] PATH_INFO: `/v3/projects/818f60266ff34f4481c6d9dce86705ce/users/1b086b2e36fd481ca81662431b1ddf42/roles/cb54b7b6fc064ff6aed21ebbbcf57b60` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.671850 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818f60266ff34f4481c6d9dce86705ce, user_id=1b086b2e36fd481ca81662431b1ddf42, role_id=cb54b7b6fc064ff6aed21ebbbcf57b60)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.674470 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.685546 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1427/2861] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:28 2022] PUT /identity/v3/projects/818f60266ff34f4481c6d9dce86705ce/users/1b086b2e36fd481ca81662431b1ddf42/roles/cb54b7b6fc064ff6aed21ebbbcf57b60 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:28.696863 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.697149 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.697943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.725223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] MFA Rules not processed for user `1b086b2e36fd481ca81662431b1ddf42`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:28.726443 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:28.739963 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:28.798297 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1435/2862] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:28.811066 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:28.812811 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:28.871567 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653d31-f7a2-4403-a6dd-073b12e2e195 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:28.875201 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:28.875883 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:28.876170 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:28.876448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:28.885829 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:28.887267 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:28.896774 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1428/2863] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:29.209210 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:29.219124 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51714f4f-c3eb-46ad-8cb0-d4667f68109f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:29.223626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b086b2e36fd481ca81662431b1ddf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818f60266ff34f4481c6d9dce86705ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:29.224281 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.224570 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.224847 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.225603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:29.225912 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:29.227534 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:29.240334 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1436/2864] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:29.244538 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:29.253767 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb00b0-e29e-4430-8937-2726b576b11b service cinder] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:29.258435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b086b2e36fd481ca81662431b1ddf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818f60266ff34f4481c6d9dce86705ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:29.259118 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.259439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.259729 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.260435 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:29.262331 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:29.290541 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1429/2865] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:29 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:29.294662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:29.309417 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222c03-256d-40ef-b98d-375b3d4102e2 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:29.366296 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b086b2e36fd481ca81662431b1ddf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818f60266ff34f4481c6d9dce86705ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:29.366969 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.367260 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.367575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.368314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:29.368626 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:29.370316 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:29.382848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1437/2866] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:29.421492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:29.431744 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5f43-84e3-49c7-8cca-7871a73d136f tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:29.436271 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b086b2e36fd481ca81662431b1ddf42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818f60266ff34f4481c6d9dce86705ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:29.437121 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.437407 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.437681 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] PATH_INFO: `/v3/projects/9b52fd9bbc7e4d028c9fdece5b408821` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.438856 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b52fd9bbc7e4d028c9fdece5b408821)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:29.440807 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:29.489283 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b52fd9bbc7e4d028c9fdece5b408821', 'request_id': 'req-1a1a44da-44ca-4534-a5b0-10d62199882a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.496753 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b52fd9bbc7e4d028c9fdece5b408821', 'request_id': 'req-1a1a44da-44ca-4534-a5b0-10d62199882a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.503021 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b52fd9bbc7e4d028c9fdece5b408821', 'request_id': 'req-1a1a44da-44ca-4534-a5b0-10d62199882a'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.517634 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] The token cache is being invalidate because project 9b52fd9bbc7e4d028c9fdece5b408821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:29.517951 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.518605 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-1a1a44da-44ca-4534-a5b0-10d62199882a tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.520289 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1430/2867] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:29 2022] DELETE /identity/v3/projects/9b52fd9bbc7e4d028c9fdece5b408821 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:29.715687 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:29.717429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:29.783711 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cd71c-c88f-45a5-b411-79c146594d63 tempest-VolumeQuotaClassesTest-125138366 tempest-VolumeQuotaClassesTest-125138366-project-admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:29.822692 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=100 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:29.842610 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:29.843522 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.843803 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.844074 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] PATH_INFO: `/v3/users/d71db8178f45410aa07366e8ea212241` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.845269 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71db8178f45410aa07366e8ea212241)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:29.847238 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:29.893812 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71db8178f45410aa07366e8ea212241'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.894465 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71db8178f45410aa07366e8ea212241'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.895069 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71db8178f45410aa07366e8ea212241'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.907332 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71db8178f45410aa07366e8ea212241'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.914857 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71db8178f45410aa07366e8ea212241'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:29.927278 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1438/2868] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:29 2022] DELETE /identity/v3/users/d71db8178f45410aa07366e8ea212241 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:29.932015 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.932499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.932638 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.952036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:29.953345 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.005008 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:30.024128 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1431/2869] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:30.033694 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:30.036540 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.096904 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287276-283d-46e7-b32f-55cba6a3e618 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:30.100552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:30.101209 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:30.101495 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:30.101771 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:30.112132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:30.113685 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:30.125053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1439/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:30.401499 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:30.403377 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.418687 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf44b-d2b2-446c-bc0d-c65ba55f3a35 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:30.424618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:30.425803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:30.426151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:30.426332 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] PATH_INFO: `/v3/projects/3eb0c99c47a84ed78b68cf3966abe835` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:30.428104 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb0c99c47a84ed78b68cf3966abe835)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:30.430119 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:30.477373 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb0c99c47a84ed78b68cf3966abe835', 'request_id': 'req-2a9fa3ae-12df-4c2d-b66a-452c64011356'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.485618 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb0c99c47a84ed78b68cf3966abe835', 'request_id': 'req-2a9fa3ae-12df-4c2d-b66a-452c64011356'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.491243 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb0c99c47a84ed78b68cf3966abe835', 'request_id': 'req-2a9fa3ae-12df-4c2d-b66a-452c64011356'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.502787 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] The token cache is being invalidate because project 3eb0c99c47a84ed78b68cf3966abe835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:30.503070 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.503704 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.505232 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1432/2871] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:30 2022] DELETE /identity/v3/projects/3eb0c99c47a84ed78b68cf3966abe835 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:30.509213 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:30.519227 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e830bf-d8fa-4864-81f4-66b37ae3fcbd service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:30.576153 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:30.576943 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:30.577219 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:30.577490 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] PATH_INFO: `/v3/users/1b086b2e36fd481ca81662431b1ddf42` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:30.578671 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b086b2e36fd481ca81662431b1ddf42)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:30.580624 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:30.582894 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:30.631248 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b086b2e36fd481ca81662431b1ddf42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.631938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b086b2e36fd481ca81662431b1ddf42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.632537 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b086b2e36fd481ca81662431b1ddf42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.646296 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b086b2e36fd481ca81662431b1ddf42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.654938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-7fa7b260-84f9-47a3-9601-206ad3dc98b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b086b2e36fd481ca81662431b1ddf42'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.667935 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1440/2872] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:30 2022] DELETE /identity/v3/users/1b086b2e36fd481ca81662431b1ddf42 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:30.938960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:30.940672 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.954296 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa3ae-12df-4c2d-b66a-452c64011356 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.013159 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.014028 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.014312 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.014589 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] PATH_INFO: `/v3/projects/818f60266ff34f4481c6d9dce86705ce` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.015803 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818f60266ff34f4481c6d9dce86705ce)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.017725 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.064406 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818f60266ff34f4481c6d9dce86705ce', 'request_id': 'req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.073877 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818f60266ff34f4481c6d9dce86705ce', 'request_id': 'req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.079885 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818f60266ff34f4481c6d9dce86705ce', 'request_id': 'req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.092446 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] The token cache is being invalidate because project 818f60266ff34f4481c6d9dce86705ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:31.092739 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.093398 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-8806b17d-e0f3-45d0-84b9-f853f1d34ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.094969 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1433/2873] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:30 2022] DELETE /identity/v3/projects/818f60266ff34f4481c6d9dce86705ce => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:31.100003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.100546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.100546 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.121140 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:31.122294 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:31.185565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1441/2874] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:31.193448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.193735 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.194036 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.203560 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:31.216834 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:31.218633 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:31.227144 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1434/2875] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:31.231962 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.243223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703d934-27a4-48ed-a236-7769d44ebbb2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.248034 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.248724 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.249006 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.249280 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.250019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:31.250328 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.251999 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.265595 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1442/2876] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:31.269934 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.280222 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370f18-20f3-4814-9470-23006b47e114 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.285024 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.285701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.285984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.286259 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.286960 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.288930 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.317561 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1435/2877] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:31 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:31.321572 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.332413 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42194639-f018-4e5c-93c0-bcb3f05e2101 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.390824 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.391442 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.391726 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.392000 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.392700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.394632 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.413218 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:31.419436 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1443/2878] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:31 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:31.423693 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.434381 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffaf9e-5248-4608-9ff2-70bb834548ee admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.439001 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.439701 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.439984 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.440258 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.440986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.442587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.453233 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1436/2879] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:31.458085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.469232 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b15aa-fd51-422d-9a00-e003752bd7c6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.474083 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5a40-66ae-4b41-ac2b-94e5a1570530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.474762 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5a40-66ae-4b41-ac2b-94e5a1570530 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.475051 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5a40-66ae-4b41-ac2b-94e5a1570530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.475331 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5a40-66ae-4b41-ac2b-94e5a1570530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.476103 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b5a40-66ae-4b41-ac2b-94e5a1570530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.477716 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b5a40-66ae-4b41-ac2b-94e5a1570530 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.489167 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1444/2880] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:31.493571 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.504925 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8f0ac-6067-4183-a592-c3b0026b5a3a admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.510352 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.511272 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.511585 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.511867 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] PATH_INFO: `/v3/projects/5a117949f1f946ab885a16bfb8fed73e/users/7621b71e7d4e486e8f1f4220651598ba/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.528784 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a117949f1f946ab885a16bfb8fed73e, user_id=7621b71e7d4e486e8f1f4220651598ba, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.531539 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.545698 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1437/2881] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:31 2022] PUT /identity/v3/projects/5a117949f1f946ab885a16bfb8fed73e/users/7621b71e7d4e486e8f1f4220651598ba/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:31.556418 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.556713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.557003 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.585662 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] MFA Rules not processed for user `7621b71e7d4e486e8f1f4220651598ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:31.586931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:31.656938 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1445/2882] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:31.690401 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.692504 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:31.751531 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54910ca-b415-4689-9ba3-1c0190d1c7ce admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.755179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be88dc-e3f7-4403-b2f4-e85e5e6d0d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.755857 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be88dc-e3f7-4403-b2f4-e85e5e6d0d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.756140 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be88dc-e3f7-4403-b2f4-e85e5e6d0d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.756413 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be88dc-e3f7-4403-b2f4-e85e5e6d0d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.765007 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be88dc-e3f7-4403-b2f4-e85e5e6d0d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.766448 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be88dc-e3f7-4403-b2f4-e85e5e6d0d04 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.775835 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1438/2883] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:31.791565 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.855261 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6b72-31c9-4fa3-827b-08d8baa518ba None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.859957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.860848 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.861132 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.861408 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] PATH_INFO: `/v3/users/7621b71e7d4e486e8f1f4220651598ba` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.862623 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7621b71e7d4e486e8f1f4220651598ba)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.864608 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.912429 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7621b71e7d4e486e8f1f4220651598ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.913002 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7621b71e7d4e486e8f1f4220651598ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.913603 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7621b71e7d4e486e8f1f4220651598ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.925922 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7621b71e7d4e486e8f1f4220651598ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.933394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7621b71e7d4e486e8f1f4220651598ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.939104 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:31.948688 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1446/2884] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:31 2022] DELETE /identity/v3/users/7621b71e7d4e486e8f1f4220651598ba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:31.955439 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.956208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.956397 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.979481 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:31.980684 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.040394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1439/2885] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:32.050130 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.051593 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.109053 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f1b60-ecd0-4318-8ea1-62fbd63d16a1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.112869 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d011b-18ab-4556-accd-b5e5f03783bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.113516 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d011b-18ab-4556-accd-b5e5f03783bf service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.113798 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d011b-18ab-4556-accd-b5e5f03783bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.114070 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d011b-18ab-4556-accd-b5e5f03783bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.123259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d011b-18ab-4556-accd-b5e5f03783bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.124765 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d011b-18ab-4556-accd-b5e5f03783bf service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.134355 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1447/2886] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:32.435078 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.436783 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.453372 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d70f-0779-431c-8bde-99217ed57084 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.458322 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.459193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.459507 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.459899 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] PATH_INFO: `/v3/projects/5a117949f1f946ab885a16bfb8fed73e` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.461590 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a117949f1f946ab885a16bfb8fed73e)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.465179 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.512737 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:32.521815 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a117949f1f946ab885a16bfb8fed73e', 'request_id': 'req-a03d3dae-5d05-4cda-97e0-cdede4b17696'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.530236 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a117949f1f946ab885a16bfb8fed73e', 'request_id': 'req-a03d3dae-5d05-4cda-97e0-cdede4b17696'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.536631 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a117949f1f946ab885a16bfb8fed73e', 'request_id': 'req-a03d3dae-5d05-4cda-97e0-cdede4b17696'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.547913 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] The token cache is being invalidate because project 5a117949f1f946ab885a16bfb8fed73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:32.548208 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.548863 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-a03d3dae-5d05-4cda-97e0-cdede4b17696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.550411 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1440/2887] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:32 2022] DELETE /identity/v3/projects/5a117949f1f946ab885a16bfb8fed73e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:32.556242 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.557078 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.557364 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.580613 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:32.581876 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.654317 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1448/2888] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:32.663795 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.664086 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.664394 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.686476 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:32.687805 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.695864 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1441/2889] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:32.700222 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.710231 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be642-d079-4b9c-a0bc-a087d0d9c083 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.715223 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.715957 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.716246 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.716571 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.717394 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:32.717780 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.719553 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.734286 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1449/2890] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:32.739816 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.750779 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252ebc-bc79-4845-8bdb-11fc5a1dd241 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.755936 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.756598 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.756886 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.757166 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.757920 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.759998 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.791664 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1442/2891] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:32.795987 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.807266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9cdc-a331-490c-863b-8e7d62d2756b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.870696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.871411 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.871700 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.871980 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.872696 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.874638 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.897010 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1450/2892] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:32.901475 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.912611 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638dcb4-f82a-4447-9cf9-732af8c4a7f0 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.917900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.918569 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.918849 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.919123 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.919889 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.921513 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.933003 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1443/2893] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:32.937584 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.947866 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a6192-2dbb-4815-b569-68dd96d4a6c1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.952552 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4664d3-55cd-498f-b864-996d5ce1d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.953240 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4664d3-55cd-498f-b864-996d5ce1d1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.953527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4664d3-55cd-498f-b864-996d5ce1d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.953805 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4664d3-55cd-498f-b864-996d5ce1d1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.954575 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4664d3-55cd-498f-b864-996d5ce1d1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.956245 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4664d3-55cd-498f-b864-996d5ce1d1e9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.968173 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1451/2894] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:52:32.972587 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.983699 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffbc4-52bd-44f9-8bd8-bf04250eae40 admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.988494 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.989384 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.989666 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.989944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] PATH_INFO: `/v3/projects/85fd25844ef14ae6b9f9dc34927fc803/users/ff3b48fc45204284bc8d9e6da49db3b6/roles/6a4dda1bb50c4b16ae906ea0a9870854` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.005512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fd25844ef14ae6b9f9dc34927fc803, user_id=ff3b48fc45204284bc8d9e6da49db3b6, role_id=6a4dda1bb50c4b16ae906ea0a9870854)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.008294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.024679 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1444/2895] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:32 2022] PUT /identity/v3/projects/85fd25844ef14ae6b9f9dc34927fc803/users/ff3b48fc45204284bc8d9e6da49db3b6/roles/6a4dda1bb50c4b16ae906ea0a9870854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:33.035503 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614383-1313-4296-8261-4228142b30e4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.035800 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614383-1313-4296-8261-4228142b30e4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.036085 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614383-1313-4296-8261-4228142b30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.044852 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:33.066709 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-89614383-1313-4296-8261-4228142b30e4 None None] MFA Rules not processed for user `ff3b48fc45204284bc8d9e6da49db3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:33.067984 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-89614383-1313-4296-8261-4228142b30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:33.138024 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1452/2896] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:33.150658 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.152512 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:33.211052 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6ee7-ce92-4a74-9203-a99b091ff9fd admin admin] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.215492 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee100-cdab-4c95-a291-a95db05ad460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a6925d9c52e4bf9ab900755b8aac7fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.216294 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee100-cdab-4c95-a291-a95db05ad460 service cinder] REQUEST_METHOD: `GET` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.216690 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee100-cdab-4c95-a291-a95db05ad460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.216972 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee100-cdab-4c95-a291-a95db05ad460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.226919 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee100-cdab-4c95-a291-a95db05ad460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.229468 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee100-cdab-4c95-a291-a95db05ad460 service cinder] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.239034 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1445/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:35.842845 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614383-1313-4296-8261-4228142b30e4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:35.913357 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614383-1313-4296-8261-4228142b30e4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:35.917834 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:35.918713 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:35.918995 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:35.919267 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] PATH_INFO: `/v3/users/ff3b48fc45204284bc8d9e6da49db3b6` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:35.920481 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3b48fc45204284bc8d9e6da49db3b6)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:35.922391 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:35.970881 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3b48fc45204284bc8d9e6da49db3b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:35.971648 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3b48fc45204284bc8d9e6da49db3b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:35.972259 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3b48fc45204284bc8d9e6da49db3b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:35.987809 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3b48fc45204284bc8d9e6da49db3b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:35.995191 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3b48fc45204284bc8d9e6da49db3b6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.008224 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1453/2898] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:35 2022] DELETE /identity/v3/users/ff3b48fc45204284bc8d9e6da49db3b6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:36.013480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] REQUEST_METHOD: `POST` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:36.013944 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:36.014043 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:36.035505 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.auth.core [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] MFA Rules not processed for user `8cead41321b144bab20ff36d66ca2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80321) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:36.036745 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:36.101868 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1446/2899] 10.222.0.57 () {58 vars in 958 bytes} [Mon Jul 25 08:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:36.112047 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:36.113502 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:36.131041 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:36.177266 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c184-8ddd-4820-a12f-34481bbe15a2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:36.180931 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d85eeb2282b4f9ca9f357c0e0948de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:36.181579 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:36.181864 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:36.182142 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:36.192567 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:36.194019 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:36.204338 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1454/2900] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:36.489037 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] Authenticating user token {{(pid=80321) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:36.490911 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.fernet_utils [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80321) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:36.505676 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6edf8-49ea-4a1a-9dc3-1af7ed1edb47 None None] Validating token access rules against request {{(pid=80321) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:36.511480 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cead41321b144bab20ff36d66ca2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf189989f41048d2bcf89c6d65f2316e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80321) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:36.512509 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:36.512712 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:36.512989 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] PATH_INFO: `/v3/projects/85fd25844ef14ae6b9f9dc34927fc803` {{(pid=80321) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:36.514193 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fd25844ef14ae6b9f9dc34927fc803)` {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:36.516180 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] RBAC: Authorization granted {{(pid=80321) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:36.517801 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:36.566151 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fd25844ef14ae6b9f9dc34927fc803', 'request_id': 'req-52e972aa-74ae-455e-a592-439fbeaf9bbc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.573134 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fd25844ef14ae6b9f9dc34927fc803', 'request_id': 'req-52e972aa-74ae-455e-a592-439fbeaf9bbc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.578640 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fd25844ef14ae6b9f9dc34927fc803', 'request_id': 'req-52e972aa-74ae-455e-a592-439fbeaf9bbc'} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.590900 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] The token cache is being invalidate because project 85fd25844ef14ae6b9f9dc34927fc803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80321) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:36.591181 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.591836 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG keystone.notifications [None req-52e972aa-74ae-455e-a592-439fbeaf9bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80321) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.593337 dv-cinder-850840-1-smb devstack@keystone.service[80321]: [pid: 80321|app: 0|req: 1447/2901] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:36 2022] DELETE /identity/v3/projects/85fd25844ef14ae6b9f9dc34927fc803 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:46.199487 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=20 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:46.587986 dv-cinder-850840-1-smb devstack@keystone.service[80321]: DEBUG dbcounter [-] [80321] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:20.192116 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:56:20.193527 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:56:20.272743 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf6bb-f106-45e5-9cdf-52c3bb849b68 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:56:20.335609 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc0a416829f433f8cd3867cde7214bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa5b4df14d4eb0b0404522558b4e76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:56:20.336271 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:56:20.336556 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:56:20.336835 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:56:20.338645 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:56:20.350672 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:56:20.352314 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9f515-3018-470e-8b89-97dd6019d6c4 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:56:20.363426 dv-cinder-850840-1-smb devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1455/2902] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Jul 25 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:56:30.358519 dv-cinder-850840-1-smb devstack@keystone.service[80320]: DEBUG dbcounter [-] [80320] Writing DB stats keystone:SELECT=58 {{(pid=80320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}